Port of Facebook's LLaMA model in C/C++
DepGraph: Towards Any Structural Pruning
OpenAI API client for Kotlin with multiplatform capabilities
An LLM Compiler for Parallel Function Calling
A RWKV management and startup tool, full automation, only 8MB
local-first semantic code search engine
Fetch source code for npm packages
Your fully private, open-source, on-device AI assistant
Specify a github or local repo, github pull request
Distributed LLM and StableDiffusion inference
Inference Llama 2 in one file of pure C
Fully private LLM chatbot that runs entirely with a browser
Run LLMs locally on Cloud Workstations