Download
State-of-the-art transformers, brick by brick. Curated Transformers is a transformer library for PyTorch. It provides state-of-the-art models that are composed of a set of reusable components. Supports state-of-the-art transformer models, including LLMs such as Falcon, Llama, and Dolly v2. Implementing a feature or bugfix benefits all models. For example, all models support 4/8-bit inference through the bitsandbytes library and each model can use the PyTorch meta device to avoid unnecessary allocations and initialization.
Features
- Each model is composed from a set of reusable building blocks, providing many benefits
- Consistent type annotations of all public APIs
- Integrates well with your existing type-checked code
- Great for education, because the building blocks are easy to study
- Minimal dependencies
- Adding new models to the library is low-effort
Project Samples
License
MIT LicenseFollow Curated Transformers
Other Useful Business Software
Earn up to 16% annual interest with Nexo.
Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform.
Geographic restrictions, eligibility, and terms apply.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Curated Transformers!
