Search Results for "llama.cpp python" - Page 2
Sort By:
Showing 27 open source projects for "llama.cpp python"
View related business solutions-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Mellum-4b-base
JetBrains’ 4B parameter code model for completions
...With a context window of 8,192 tokens, it excels at code completion, fill-in-the-middle tasks, and intelligent code suggestions for professional developer tools and IDEs. The model is efficient for both cloud inference with vLLM and local deployment using llama.cpp or Ollama, thanks to its bf16 precision and AMP training. While the base model is not fine-tuned for downstream tasks, it is designed to be easily adapted through supervised fine-tuning (SFT) or reinforcement learning (RL). Benchmarks on RepoBench, SAFIM, and HumanEval demonstrate its competitive performance, with specialized fine-tuned versions for Python already showing strong improvements. -
2
LocalLLM Studio
Chat with local GGUF LLMs on your own machine
...LLM Apps & Agents Apache-2.0 v1.0.5 100% AI-built 0 0 Get LocalLLM Studio View source Website Run open-weight language models (GGUF) fully offline on your own hardware via llama.cpp: a chat interface with system prompts, conversation history, adjustable sampling, and simple retrieval over your own files. You supply the model file — nothing is sent to any server. At a glance Downloads 0 Views 5 Rating No ratings yet License Apache-2.0 Built by Python (tkinter + CLI), llama-cpp-python Branch main Updated Sep 4, 2026 Screenshots Releases All artifacts are signed — verify your download . ...
