Falcon 2

LLaVA (Large Language-and-Vision Assistant) is an innovative multimodal model that integrates a vision encoder with the Vicuna language model to facilitate comprehensive visual and language understanding. Through end-to-end training, LLaVA exhibits impressive chat capabilities, emulating the multimodal functionalities of models like GPT-4. Notably, LLaVA-1.5 has achieved state-of-the-art performance across 11 benchmarks, utilizing publicly available data and completing training in approximately one day on a single 8-A100 node, surpassing methods that rely on billion-scale datasets. The development of LLaVA involved the creation of a multimodal instruction-following dataset, generated using language-only GPT-4. This dataset comprises 158,000 unique language-image instruction-following samples, including conversations, detailed descriptions, and complex reasoning tasks. This data has been instrumental in training LLaVA to perform a wide array of visual and language tasks effectively.

Inkling is an open-weights multimodal AI model from Thinking Machines designed as a customizable foundation model for developers, researchers, and enterprises. The model is a Mixture-of-Experts transformer with 975 billion total parameters, 41 billion active parameters, and support for context windows up to 1 million tokens. Inkling was trained from scratch on text, images, audio, and video, giving it native capabilities across reasoning, coding, agentic tool use, vision, audio, factuality, and instruction following. It is built with controllable thinking effort so users can balance performance, latency, and token efficiency for different workloads. The model is available for fine-tuning on Tinker, with playground access, API availability through ecosystem partners, and full weights published on Hugging Face. Built for customization, Inkling gives teams an open-weights base model for building domain-specific AI systems, multimodal agents, coding workflows, research tools, and more.