Higgsfield is an open-source, fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters, such as Large Language Models (LLMs).
Features
- Allocating exclusive and non-exclusive access to compute resources (nodes) to users for their training tasks
- Supporting ZeRO-3 deepspeed API and fully sharded data parallel API of PyTorch, enabling efficient sharding for trillion-parameter models
- Offering a framework for initiating, executing, and monitoring the training of large neural networks on allocated nodes
- Managing resource contention by maintaining a queue for running experiments
- Facilitating continuous integration of machine learning development through seamless integration with GitHub and GitHub Actions
- Higgsfield streamlines the process of training massive models and empowers developers with a versatile and robust toolset
- Documentation available
Categories
Machine LearningLicense
Apache License V2.0Follow higgsfield
Other Useful Business Software
Veeam Data Platform v13.1 - Get Your Free Trial
Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of higgsfield!