Download
ChatGLM-6B is an open bilingual (Chinese + English) conversational language model based on the GLM architecture, with approximately 6.2 billion parameters. The project provides inference code, demos (command line, web, API), quantization support for lower memory deployment, and tools for finetuning (e.g., via P-Tuning v2). It is optimized for dialogue and question answering with a balance between performance and deployability in consumer hardware settings. Support for quantized inference (INT4, INT8) to reduce GPU memory requirements. Automatic mode switching between precision/memory tradeoffs (full/quantized).
Features
- Bilingual dialogue capability (Chinese and English)
- Support for quantized inference (INT4, INT8) to reduce GPU memory requirements
- Parameter-efficient finetuning (P-Tuning v2 method)
- CLI, web demo, and API interfaces included
- Automatic mode switching between precision / memory tradeoffs (full / quantized)
- Integration with the Hugging Face / Transformers ecosystem (trust_remote_code, model loading, tokenization)
Project Samples
License
Apache License V2.0Follow ChatGLM-6B
Other Useful Business Software
Paessler: Easy to Use With Enterprise Power. Free Trial
You shouldn't have to choose between a monitoring tool that's easy to use and one that's powerful enough for a complex environment. PRTG's low-code interface lets any admin build dashboards, set alerts and monitor devices without scripting, while custom sensors and full API access are there when your team needs deeper control. One platform, no compromise. Download a free 30-day trial now.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of ChatGLM-6B!
