CTransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.

Features

It provides a unified interface for all models
It also provides access to the low-level C API
It can be used with models hosted on the Hub
It is integrated into LangChain
Install CUDA libraries
Load a GPTQ model

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow CTransformers

CTransformers Web Site

Other Useful Business Software

8 Monitoring Tools in One APM. Install in 5 Minutes.

Errors, performance, logs, uptime, hosts, anomalies, dashboards, and check-ins. One interface.

AppSignal works out of the box for Ruby, Elixir, Node.js, Python, and more. 30-day free trial, no credit card required.

Start Free

Rate This Project

User Reviews

Be the first to post a review of CTransformers!

Additional Project Details

Programming Language

Related Categories

C Large Language Models (LLM)

Registered

2023-08-25

Similar Business Software

Gemini Enterprise Agent Platform

Gemini Enterprise Agent Platform is a comprehensive solution from Google Cloud designed to help organizations build, scale, govern, and optimize AI agents. It represents the evolution of Vertex AI, combining advanced model development with new capabilities for agent orchestration and...

See Software
LM-Kit.NET

LM-Kit.NET is a cutting-edge, high-level inference SDK designed specifically to bring the advanced capabilities of Large Language Models (LLM) into the C# ecosystem. Tailored for developers working within .NET, LM-Kit.NET provides a comprehensive suite of powerful Generative AI tools, making...

See Software
Google AI Studio

Google AI Studio is a unified development platform that helps teams explore, build, and deploy applications using Google’s most advanced AI models, including Gemini 3. It brings text, image, audio, and video models together in one interactive playground. With vibe coding, developers can use...

See Software
GPT-4

GPT-4 (Generative Pre-trained Transformer 4) is a large-scale unsupervised language model, yet to be released by OpenAI. GPT-4 is the successor to GPT-3 and part of the GPT-n series of natural language processing models, and was trained on a dataset of 45TB of text to produce human-like text...

See Software
GPT-3

Our GPT-3 models can understand and generate natural language. We offer four main models with different levels of power suitable for different tasks. Davinci is the most capable model, and Ada is the fastest. The main GPT-3 models are meant to be used with the text completion endpoint. We also...

See Software
GPT-3.5

GPT-3.5 is the next evolution of GPT 3 large language model from OpenAI. GPT-3.5 models can understand and generate natural language. We offer four main models with different levels of power suitable for different tasks. The main GPT-3.5 models are meant to be used with the text completion...

See Software

Report inappropriate content

CTransformers

Python bindings for the Transformer models implemented in C/C++

Get an email when there's a new version of CTransformers

Features

Project Samples

Project Activity

Categories

License

Follow CTransformers

User Reviews

Additional Project Details

Programming Language

Related Categories

Registered