Showing 3 open source projects for "llama.cpp python"

View related business solutions
  • Build Securely on AWS with Proven Frameworks Icon
    Build Securely on AWS with Proven Frameworks

    Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

    Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
    Download Now
  • Patching and Endpoint Management for Under $1/Endpoint Icon
    Patching and Endpoint Management for Under $1/Endpoint

    OS and third-party patching, vulnerability insights, and remote control included

    Splashtop AEM gives IT teams automated patching, monitoring, and unattended remote access for Windows and macOS. No long setup, no paying extra for key features.
    Start Free Trial
  • 1
    llama.cpp

    llama.cpp

    Port of Facebook's LLaMA model in C/C++

    The llama.cpp project enables the inference of Meta's LLaMA model (and other models) in pure C/C++ without requiring a Python runtime. It is designed for efficient and fast model execution, offering easy integration for applications needing LLM-based capabilities. The repository focuses on providing a highly optimized and portable implementation for running large language models directly within C/C++ environments.
    5.0 out of 5 stars 1 Review
    Downloads: 117 This Week
    Last Update:
    See Project
  • 2
    DocsGPT

    DocsGPT

    Private AI agents, assistants and search over your own documents

    DocsGPT is an open-source (MIT) platform for private AI agents, assistants and enterprise search over your own documents, built by Arc53. It ingests PDFs, Office files, scanned pages (OCR), web pages and repositories, syncs Google Drive, SharePoint, Confluence, GitHub and S3, and answers with citations to the source passage. Agents call tools, APIs and MCP servers with per-action approval; a visual builder chains AI steps, conditions and code into workflows; agents can produce DOCX, XLSX,...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 3
    KoboldCpp

    KoboldCpp

    Run GGUF models easily with a UI or API. One File. Zero Install.

    KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI. It's a single self-contained distributable that builds off llama.cpp and adds many additional powerful features.
    Leader badge
    Downloads: 384 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next