Dolly

Train and serve large AI models at scale with a single command. Point to your S3 bucket and go. We handle the rest, orchestration, efficiency, node failures, and infrastructure. Simple and scalable. MosaicML enables you to easily train and deploy large AI models on your data, in your secure environment. Stay on the cutting edge with our latest recipes, techniques, and foundation models. Developed and rigorously tested by our research team. With a few simple steps, deploy inside your private cloud. Your data and models never leave your firewalls. Start in one cloud, and continue on another, without skipping a beat. Own the model that's trained on your own data. Introspect and better explain the model decisions. Filter the content and data based on your business needs. Seamlessly integrate with your existing data pipelines, experiment trackers, and other tools. We are fully interoperable, cloud-agnostic, and enterprise proved.

Multilingual T5 (mT5) is a massively multilingual pretrained text-to-text transformer model, trained following a similar recipe as T5. This repo can be used to reproduce the experiments in the mT5 paper. mT5 is pretrained on the mC4 corpus, covering 101 languages: Afrikaans, Albanian, Amharic, Arabic, Armenian, Azerbaijani, Basque, Belarusian, Bengali, Bulgarian, Burmese, Catalan, Cebuano, Chichewa, Chinese, Corsican, Czech, Danish, Dutch, English, Esperanto, Estonian, Filipino, Finnish, French, Galician, Georgian, German, Greek, Gujarati, Haitian Creole, Hausa, Hawaiian, Hebrew, Hindi, Hmong, Hungarian, Icelandic, Igbo, Indonesian, Irish, Italian, Japanese, Javanese, Kannada, Kazakh, Khmer, Korean, Kurdish, Kyrgyz, Lao, Latin, Latvian, Lithuanian, Luxembourgish, Macedonian, Malagasy, Malay, Malayalam, Maltese, Maori, Marathi, Mongolian, Nepali, Norwegian, Pashto, Persian, Polish, Portuguese, Punjabi, Romanian, Russian, Samoan, Scottish Gaelic, Serbian, Shona, Sindhi, and more.