Higgsfield is an open-source, fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters, such as Large Language Models (LLMs).
Features
- Allocating exclusive and non-exclusive access to compute resources (nodes) to users for their training tasks
- Supporting ZeRO-3 deepspeed API and fully sharded data parallel API of PyTorch, enabling efficient sharding for trillion-parameter models
- Offering a framework for initiating, executing, and monitoring the training of large neural networks on allocated nodes
- Managing resource contention by maintaining a queue for running experiments
- Facilitating continuous integration of machine learning development through seamless integration with GitHub and GitHub Actions
- Higgsfield streamlines the process of training massive models and empowers developers with a versatile and robust toolset
- Documentation available
Categories
Machine LearningLicense
Apache License V2.0Follow higgsfield
Other Useful Business Software
Fully Managed MySQL, PostgreSQL, and SQL Server
Cloud SQL handles your database ops end to end, so you can focus on your app.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of higgsfield!