Higgsfield is an open-source, fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters, such as Large Language Models (LLMs).
Features
- Allocating exclusive and non-exclusive access to compute resources (nodes) to users for their training tasks
- Supporting ZeRO-3 deepspeed API and fully sharded data parallel API of PyTorch, enabling efficient sharding for trillion-parameter models
- Offering a framework for initiating, executing, and monitoring the training of large neural networks on allocated nodes
- Managing resource contention by maintaining a queue for running experiments
- Facilitating continuous integration of machine learning development through seamless integration with GitHub and GitHub Actions
- Higgsfield streamlines the process of training massive models and empowers developers with a versatile and robust toolset
- Documentation available
Categories
Machine LearningLicense
Apache License V2.0Follow higgsfield
You Might Also Like
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of higgsfield!