Fundamental research to develop new architectures for foundation models and AI, focusing on modeling generality and capability, as well as training stability and efficiency.
Features
- General technology for enabling AI capabilities w/ LLMs and MLLMs
- Revolutionizing Transformers for (M)LLMs and AI
- TorchScale - Transformers at (any) Scale
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- Focusing on modeling generality and capability, as well as training stability and efficiency
- Fundamental research to develop new architectures for foundation models and AI
Categories
Large Language Models (LLM)License
MIT LicenseFollow GeneralAI
Other Useful Business Software
$300 Free Credits to Build on Google Cloud
Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of GeneralAI!