Download
ChatGLM3 is ZhipuAI & Tsinghua KEG’s third-gen conversational model suite centered on the 6B-parameter ChatGLM3-6B. It keeps the series’ smooth dialog and low deployment cost while adding native tool use (function calling), a built-in code interpreter, and agent-style workflows. The family includes base and long-context variants (8K/32K/128K). The repo ships Python APIs, CLI and web demos (Gradio/Streamlit), an OpenAI-format API server, and a compact fine-tuning kit. Quantization (4/8-bit), CPU/MPS support, and accelerator backends (TensorRT-LLM, OpenVINO, chatglm.cpp) enable lightweight local or edge deployment.
Features
- Multi-turn chat with native tools: Function Call, Code Interpreter, agent tasks.
- Long-context models: 8K, 32K, and 128K sequence lengths.
- Easy local deployment: INT4/INT8 quantization, CPU & Apple MPS support.
- Turnkey demos: CLI, Gradio/Streamlit web UIs, OpenAI-style REST server.
- Accelerator integrations: TensorRT-LLM, OpenVINO, chatglm.cpp, multi-GPU.
- Fine-tuning kit: LoRA/QLoRA/PTuning examples and scripts.
Project Samples
Categories
Large Language Models (LLM)License
Apache License V2.0Follow ChatGLM3
Other Useful Business Software
$300 Free Credits for Your Google Cloud Projects
Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of ChatGLM3!
