Higgsfield is an open-source, fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters, such as Large Language Models (LLMs).
Features
- Allocating exclusive and non-exclusive access to compute resources (nodes) to users for their training tasks
- Supporting ZeRO-3 deepspeed API and fully sharded data parallel API of PyTorch, enabling efficient sharding for trillion-parameter models
- Offering a framework for initiating, executing, and monitoring the training of large neural networks on allocated nodes
- Managing resource contention by maintaining a queue for running experiments
- Facilitating continuous integration of machine learning development through seamless integration with GitHub and GitHub Actions
- Higgsfield streamlines the process of training massive models and empowers developers with a versatile and robust toolset
- Documentation available
Categories
Machine LearningLicense
Apache License V2.0Follow higgsfield
Other Useful Business Software
MongoDB Atlas runs apps anywhere
MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of higgsfield!