Fundamental research to develop new architectures for foundation models and AI, focusing on modeling generality and capability, as well as training stability and efficiency.
Features
- General technology for enabling AI capabilities w/ LLMs and MLLMs
- Revolutionizing Transformers for (M)LLMs and AI
- TorchScale - Transformers at (any) Scale
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- Focusing on modeling generality and capability, as well as training stability and efficiency
- Fundamental research to develop new architectures for foundation models and AI
Categories
Large Language Models (LLM)License
MIT LicenseFollow GeneralAI
Other Useful Business Software
Stop Cyber Threats with VM-Series Next-Gen Firewall on Azure
Gain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of GeneralAI!