Download
State-of-the-art transformers, brick by brick. Curated Transformers is a transformer library for PyTorch. It provides state-of-the-art models that are composed of a set of reusable components. Supports state-of-the-art transformer models, including LLMs such as Falcon, Llama, and Dolly v2. Implementing a feature or bugfix benefits all models. For example, all models support 4/8-bit inference through the bitsandbytes library and each model can use the PyTorch meta device to avoid unnecessary allocations and initialization.
Features
- Each model is composed from a set of reusable building blocks, providing many benefits
- Consistent type annotations of all public APIs
- Integrates well with your existing type-checked code
- Great for education, because the building blocks are easy to study
- Minimal dependencies
- Adding new models to the library is low-effort
Project Samples
License
MIT LicenseFollow Curated Transformers
Other Useful Business Software
Demo Series - Small Business Backup By Veeam
Watch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Curated Transformers!
