Search Results for "llama.cpp"

The C#/.NET binding of llama.cpp. It provides APIs to infer the LLaMa Models and deploy it on the local environment. It works on both Windows, Linux and MAC without the requirement for compiling llama.cpp yourself. Its performance is close to llama.cpp. Furthermore, it provides integrations with other projects such as BotSharp to provide higher-level applications and UI.

OpenMonoAgent.ai is a self-hosted coding agent designed to run entirely on the user’s own hardware. It pairs a .NET CLI with a local llama.cpp inference server so developers can use agentic coding workflows without cloud subscriptions or per-token billing. The project emphasizes privacy, local control, and ownership of the model, compute, and project data. It includes a terminal-native workflow, built-in tools, Docker sandboxing, and code intelligence features. The system can run on CPU or GPU and is designed to auto-configure itself when possible. ...

...It is built with a strong focus on accessibility and democratization, enabling users to run AI workflows even on low-cost hardware while maintaining flexibility in choosing providers such as OpenAI, Gemini, Anthropic, and self-hosted solutions like Ollama or llama.cpp. The platform introduces a concept of “assistants,” which abstract prompting into reusable tools for tasks like translation, summarization, or document analysis, making it easier for non-technical users to leverage AI capabilities. It also incorporates advanced features such as retrieval-augmented generation, plugin extensibility, and support for multiple data sources, allowing users to integrate their own files and knowledge bases into conversations.