Download
SWIFT LLM is a comprehensive framework developed within the ModelScope ecosystem for training, fine-tuning, evaluating, and deploying large language models and multimodal models. The platform provides a full machine learning pipeline that supports tasks ranging from model pre-training to reinforcement learning alignment techniques. It integrates with popular inference engines such as vLLM and LMDeploy to accelerate deployment and runtime performance. The framework also includes support for many modern training strategies, including preference learning methods and parameter-efficient fine-tuning techniques. ms-swift is designed to work with hundreds of language and multimodal models, providing a unified environment for experimentation and production deployment.
Features
- Full pipeline for training and fine-tuning large models
- Support for hundreds of language and multimodal models
- Integration with accelerated inference engines
- Tools for evaluation and deployment workflows
- Support for advanced preference learning algorithms
- Model quantization and optimization capabilities
Project Samples
