Python bindings for the Transformer models implemented in C/C++ using GGML library.
Features
- It provides a unified interface for all models
- It also provides access to the low-level C API
- It can be used with models hosted on the Hub
- It is integrated into LangChain
- Install CUDA libraries
- Load a GPTQ model
Categories
Large Language Models (LLM)License
MIT LicenseFollow CTransformers
Other Useful Business Software
Build Agents and Models on One Platform
Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of CTransformers!