Fundamental research to develop new architectures for foundation models and AI, focusing on modeling generality and capability, as well as training stability and efficiency.

Features

  • General technology for enabling AI capabilities w/ LLMs and MLLMs
  • Revolutionizing Transformers for (M)LLMs and AI
  • TorchScale - Transformers at (any) Scale
  • Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  • Focusing on modeling generality and capability, as well as training stability and efficiency
  • Fundamental research to develop new architectures for foundation models and AI

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow GeneralAI

GeneralAI Web Site

Other Useful Business Software
Stop Cyber Threats with VM-Series Next-Gen Firewall on Azure Icon
Stop Cyber Threats with VM-Series Next-Gen Firewall on Azure

Native application identity and user-based security for your Azure cloud

Gain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
Get a free trial
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of GeneralAI!

Additional Project Details

Programming Language

Python

Related Categories

Python Large Language Models (LLM)

Registered

2023-08-21