New set of lightweight state-of-the-art, open foundation models
Port of Facebook's LLaMA model in C/C++
AI Browser Automation
A lightweight framework for building LLM-based agents
LM Studio CLI
CLI proxy that reduces LLM token consumption
Free ChatGPT&DeepSeek API Key
Phi-3.5 for Mac: Locally-run Vision and Language Models
A lightweight vLLM implementation built from scratch
Run Local LLMs on Any Device. Open-source
Skywork-R1V is an advanced multimodal AI model series
the terminal client for Ollama
On the Structural Pruning of Large Language Models
LightLLM is a Python-based LLM (Large Language Model) inference
Clippy, now with some AI
Implementation for MatMul-free LM
Run PyTorch LLMs locally on servers, desktop and mobile
lightweight package to simplify LLM API calls
Cybersecurity AI (CAI), the framework for AI Security
Fast Multimodal LLM on Mobile Devices
Generate music based on natural language prompts using LLMs
OpenAI-compatible proxy that aggregates free-tier keys from ~14 AI
Document (PDF, Word, PPTX ...) extraction and parse API
Mac app for Ollama
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)