Audience
AI and LLM developers
About Ferret
An End-to-End MLLM that Accept Any-Form Referring and Ground Anything in Response.
Ferret Model - Hybrid Region Representation + Spatial-aware Visual Sampler enable fine-grained and open-vocabulary referring and grounding in MLLM.
GRIT Dataset (~1.1M) - A Large-scale, Hierarchical, Robust ground-and-refer instruction tuning dataset.
Ferret-Bench - A multimodal evaluation benchmark that jointly requires Referring/Grounding, Semantics, Knowledge, and Reasoning.
Other Popular Alternatives & Related Software
GLM-5.3-Flash
GLM-5.3-Flash is Z.ai’s natively multimodal model in the GLM-5 series (previously previewed as Ox Alpha), designed to deliver strong coding, agentic, visual, and knowledge-work performance at relatively low inference cost. It uses 320 billion total parameters with 18 billion active parameters, along with a hybrid architecture that combines sparse and linear attention to reduce the cost of long-context processing. The model supports context lengths of up to one million tokens and was trained on a 30-trillion-token multimodal corpus. GLM-5.3-Flash can reason across text, images, documents, interfaces, dashboards, and other visual information while using that feedback to refine its own outputs. Z.ai reports substantial gains over GLM-5.2 on coding and agentic benchmarks, including DeepSWE and AutomationBench, while approaching higher-cost frontier models on several evaluations.
Learn more
MiniMax M3
MiniMax M3 is an open-weight multimodal AI model designed for coding, agentic workflows, long-context reasoning, and complex automation tasks. The model combines frontier-level coding performance, native multimodal understanding, and a context window of up to 1 million tokens. MiniMax M3 uses MiniMax Sparse Attention to improve long-context efficiency while reducing compute requirements for large-scale inputs. It supports text, image, and video understanding, making it useful for workflows that combine code, documents, visual references, and tool-driven tasks. The model is built for repository-scale reasoning, software engineering, autonomous task execution, tool calling, and multi-step agent workflows. MiniMax M3 helps developers, AI teams, and enterprises build capable agents that can reason across large contexts and work with multimodal information.
Learn more
Inkling
Inkling is an open-weights multimodal AI model from Thinking Machines designed as a customizable foundation model for developers, researchers, and enterprises. The model is a Mixture-of-Experts transformer with 975 billion total parameters, 41 billion active parameters, and support for context windows up to 1 million tokens. Inkling was trained from scratch on text, images, audio, and video, giving it native capabilities across reasoning, coding, agentic tool use, vision, audio, factuality, and instruction following. It is built with controllable thinking effort so users can balance performance, latency, and token efficiency for different workloads. The model is available for fine-tuning on Tinker, with playground access, API availability through ecosystem partners, and full weights published on Hugging Face. Built for customization, Inkling gives teams an open-weights base model for building domain-specific AI systems, multimodal agents, coding workflows, research tools, and more.
Learn more
Seed2.1 Pro
Seed2.1 Pro is a next-generation AI productivity model built to handle complex, real-world work across general agents, code engineering, and multimodal understanding. It reliably executes multi-step tasks for high-value office work and everyday consultation, including project planning, file processing, research, tool use, spreadsheet analysis, lesson-plan slide generation, and industry report creation across tools and environments. In software development workflows, Seed2.1 Pro strengthens end-to-end delivery by improving requirement understanding, architecture design, coding, debugging, implementation, and validation. Its agent capabilities are designed to make steady progress on difficult tasks and return practical, verifiable results rather than isolated responses. The model also advances knowledge, reasoning, visual understanding, spatial reasoning, and long-context processing, giving agents a stronger foundation for complex decision-making and execution.
Learn more
Pricing
Starting Price:
Free
Pricing Details:
Open source
Free Version:
Free Version available.
Integrations
No integrations listed.
Company Information
Apple
Founded: 1976
United States
github.com/apple/ml-ferret
Other Useful Business Software
Build Agents and Models on One Platform
Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
Product Details
Platforms Supported
Cloud
Training
Documentation