ChatLLM.cpp Files

Pure C++ implementation of several models for real-time chatting

This is an exact mirror of the ChatLLM.cpp project, hosted at https://github.com/foldl/chatllm.cpp. SourceForge is not affiliated with ChatLLM.cpp.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
chatllm_win_x64.7z	2026-05-27	11.4 MB	0
README.md	2026-05-27	265 Bytes	0
v2026.05 source code.tar.gz	2026-05-27	3.1 MB	0
v2026.05 source code.zip	2026-05-27	3.6 MB	1
Totals: 4 Items		18.1 MB	1

New models

Gemma-4 (known issue [#128])
InternVL3.5

Other updates

Video input implemented for all models that support it.
q4_k quantization works now.
A modified version of WebUI from llama.cpp is used.

Source: README.md, updated 2026-05-27

Other Useful Business Software

Go From AI Idea to AI App Fast

One platform to build, fine-tune, and deploy ML models. No MLOps team required.

Access Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.

Try Free

Build Securely on Azure with Proven Frameworks

Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.

Download Now

Go From AI Idea to AI App Fast

One platform to build, fine-tune, and deploy ML models. No MLOps team required.

Access Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.

Try Free

Recommended Projects

Artificial Intelligence Controller
AICI: Prompts as (Wasm) Programs
FlashInfer
FlashInfer: Kernel Library for LLM Serving
OpenLLM
Operating LLMs in production
optillm
Optimizing inference proxy for LLMs
LoRAX
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

ChatLLM.cpp Files

Pure C++ implementation of several models for real-time chatting

Get an email when there's a new version of ChatLLM.cpp

New models

Other updates