MPT-7B
Introducing MPT-7B, the latest entry in our MosaicML Foundation Series. MPT-7B is a transformer trained from scratch on 1T tokens of text and code. It is open source, available for commercial use, and matches the quality of LLaMA-7B. MPT-7B was trained on the MosaicML platform in 9.5 days with zero human intervention at a cost of ~$200k.
Now you can train, finetune, and deploy your own private MPT models, either starting from one of our checkpoints or training from scratch. For inspiration, we are also releasing three finetuned models in addition to the base MPT-7B: MPT-7B-Instruct, MPT-7B-Chat, and MPT-7B-StoryWriter-65k+, the last of which uses a context length of 65k tokens!
Learn more
Falcon-40B
Falcon-40B is a 40B parameters causal decoder-only model built by TII and trained on 1,000B tokens of RefinedWeb enhanced with curated corpora. It is made available under the Apache 2.0 license.
Why use Falcon-40B?
It is the best open-source model currently available. Falcon-40B outperforms LLaMA, StableLM, RedPajama, MPT, etc. See the OpenLLM Leaderboard.
It features an architecture optimized for inference, with FlashAttention and multiquery.
It is made available under a permissive Apache 2.0 license allowing for commercial use, without any royalties or restrictions.
⚠️ This is a raw, pretrained model, which should be further finetuned for most usecases. If you are looking for a version better suited to taking generic instructions in a chat format, we recommend taking a look at Falcon-40B-Instruct.
Learn more
Inkling
Inkling is an open-weights multimodal AI model from Thinking Machines designed as a customizable foundation model for developers, researchers, and enterprises. The model is a Mixture-of-Experts transformer with 975 billion total parameters, 41 billion active parameters, and support for context windows up to 1 million tokens. Inkling was trained from scratch on text, images, audio, and video, giving it native capabilities across reasoning, coding, agentic tool use, vision, audio, factuality, and instruction following. It is built with controllable thinking effort so users can balance performance, latency, and token efficiency for different workloads. The model is available for fine-tuning on Tinker, with playground access, API availability through ecosystem partners, and full weights published on Hugging Face. Built for customization, Inkling gives teams an open-weights base model for building domain-specific AI systems, multimodal agents, coding workflows, research tools, and more.
Learn more
Ollama
Ollama is an innovative platform that focuses on providing AI-powered tools and services, designed to make it easier for users to interact with and build AI-driven applications. Run AI models locally. By offering a range of solutions, including natural language processing models and customizable AI features, Ollama empowers developers, businesses, and organizations to integrate advanced machine learning technologies into their workflows. With an emphasis on usability and accessibility, Ollama strives to simplify the process of working with AI, making it an appealing option for those looking to harness the potential of artificial intelligence in their projects.
Learn more
