Download
OpenDelta is an open-source parameter-efficient fine-tuning library that enables efficient adaptation of large-scale pre-trained models using delta tuning techniques. OpenDelta is a toolkit for parameter-efficient tuning methods (we dub it as delta tuning), by which users could flexibly assign (or add) a small amount parameters to update while keeping the most parameters frozen. By using OpenDelta, users could easily implement prefix-tuning, adapters, Lora, or any other types of delta tuning with preferred PTMs.
Features
- Supports parameter-efficient tuning for transformer models
- Works with popular models like BERT, GPT, and T5
- Open-source with flexible customization for NLP tasks
- Compatible with Hugging Face Transformers and PyTorch
- Reduces computational cost and memory footprint for fine-tuning
- Implements multiple tuning strategies including adapter layers
Project Samples
Categories
Natural Language Processing (NLP)License
Apache License V2.0Follow OpenDelta
Other Useful Business Software
Passwordless Authentication and Passwordless Security
It’s no secret — passwords can be a real headache, both for the people who use them and the people who manage them. Over time, we’ve created hundreds of passwords, it’s easy to lose track of them and they’re easily compromised. Fortunately, passwordless authentication is becoming a feasible reality for many businesses. Duo can help you get there.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of OpenDelta!