KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI. It's a single self-contained distributable that builds off llama.cpp and adds many additional powerful features.

Features

  • Single file executable, with no installation required and no external dependencies
  • Runs on CPU or GPU, supports full or partial offloaded
  • LLM text generation (Supports all GGML and GGUF models, backwards compatibility with ALL past models)
  • Image Generation (Stable Diffusion 1.5, SDXL, SD3, Flux)
  • Speech-To-Text (Voice Recognition) via Whisper
  • Text-To-Speech (Voice Generation) via OuteTTS
  • Provides many compatible APIs endpoints for many popular webservices (KoboldCppApi OpenAiApi OllamaApi A1111ForgeApi ComfyUiApi WhisperTranscribeApi XttsApi OpenAiSpeechApi)
  • Bundled KoboldAI Lite UI with editing tools, save formats, memory, world info, author's note, characters, scenarios.
  • Includes multiple modes (chat, adventure, instruct, storywriter) and UI Themes (aesthetic roleplay, classic writer, corporate assistant, messsenger)
  • Supports loading Tavern Character Cards, importing many different data formats from various sites, reading or exporting JSON savefiles and persistent stories.
  • Many other features including new samplers, regex support, websearch, RAG via TextDB and more.
  • Ready-to-use binaries for Windows, MacOS, Linux. Runs directly with Colab, Docker, also supports other platforms if self-compiled (like Android (via Termux) and Raspberry PI).

Project Samples

Project Activity

See All Activity >

License

Affero GNU Public License

Follow KoboldCpp

KoboldCpp Web Site

Other Useful Business Software
Enterprise-grade ITSM, for every business Icon
Enterprise-grade ITSM, for every business

Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity.

Freshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
Try it Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of KoboldCpp!

Additional Project Details

Operating Systems

Android, Linux, Mac, Windows

Languages

English

Intended Audience

Advanced End Users, Developers, End Users/Desktop, System Administrators

User Interface

Command-line, Console/Terminal, Non-interactive (Daemon), Web-based, Win32 (MS Windows), X Window System (X11)

Programming Language

C++, JavaScript, Python

Related Categories

Python AI Image Generators, Python AI Text Generators, Python Generative AI, C++ AI Image Generators, C++ AI Text Generators, C++ Generative AI, JavaScript AI Image Generators, JavaScript AI Text Generators, JavaScript Generative AI

Registered

2025-05-05