Audience
AI and LLM developers
About Ferret
An End-to-End MLLM that Accept Any-Form Referring and Ground Anything in Response.
Ferret Model - Hybrid Region Representation + Spatial-aware Visual Sampler enable fine-grained and open-vocabulary referring and grounding in MLLM.
GRIT Dataset (~1.1M) - A Large-scale, Hierarchical, Robust ground-and-refer instruction tuning dataset.
Ferret-Bench - A multimodal evaluation benchmark that jointly requires Referring/Grounding, Semantics, Knowledge, and Reasoning.
Other Popular Alternatives & Related Software
Inkling
Inkling is an open-weights multimodal AI model from Thinking Machines designed as a customizable foundation model for developers, researchers, and enterprises. The model is a Mixture-of-Experts transformer with 975 billion total parameters, 41 billion active parameters, and support for context windows up to 1 million tokens. Inkling was trained from scratch on text, images, audio, and video, giving it native capabilities across reasoning, coding, agentic tool use, vision, audio, factuality, and instruction following. It is built with controllable thinking effort so users can balance performance, latency, and token efficiency for different workloads. The model is available for fine-tuning on Tinker, with playground access, API availability through ecosystem partners, and full weights published on Hugging Face. Built for customization, Inkling gives teams an open-weights base model for building domain-specific AI systems, multimodal agents, coding workflows, research tools, and more.
Learn more
Seed2.1 Pro
Seed2.1 Pro is a next-generation AI productivity model built to handle complex, real-world work across general agents, code engineering, and multimodal understanding. It reliably executes multi-step tasks for high-value office work and everyday consultation, including project planning, file processing, research, tool use, spreadsheet analysis, lesson-plan slide generation, and industry report creation across tools and environments. In software development workflows, Seed2.1 Pro strengthens end-to-end delivery by improving requirement understanding, architecture design, coding, debugging, implementation, and validation. Its agent capabilities are designed to make steady progress on difficult tasks and return practical, verifiable results rather than isolated responses. The model also advances knowledge, reasoning, visual understanding, spatial reasoning, and long-context processing, giving agents a stronger foundation for complex decision-making and execution.
Learn more
MiniMax M3
MiniMax M3 is an open-weight multimodal AI model designed for coding, agentic workflows, long-context reasoning, and complex automation tasks. The model combines frontier-level coding performance, native multimodal understanding, and a context window of up to 1 million tokens. MiniMax M3 uses MiniMax Sparse Attention to improve long-context efficiency while reducing compute requirements for large-scale inputs. It supports text, image, and video understanding, making it useful for workflows that combine code, documents, visual references, and tool-driven tasks. The model is built for repository-scale reasoning, software engineering, autonomous task execution, tool calling, and multi-step agent workflows. MiniMax M3 helps developers, AI teams, and enterprises build capable agents that can reason across large contexts and work with multimodal information.
Learn more
Gemini 3.5 Flash Cyber
Gemini 3.5 Flash Cyber is a specialized cyber-focused model built on Gemini 3.5 Flash and fine-tuned to find, validate, and fix cybersecurity vulnerabilities efficiently at scale. It is designed for defensive security workflows where organizations need to identify critical weaknesses faster and generate reliable patches before those issues can be exploited. Flash’s combination of performance and efficiency makes it a strong foundation for scanning code, reasoning about security flaws, validating whether findings are real, and proposing targeted remediations across large software environments. Within CodeMender, multiple Gemini 3.5 Flash Cyber agents work together and combine their findings into a single report, helping the system investigate vulnerabilities from different angles and improve the quality of the final result. This coordinated agent setup delivers competitive frontier performance on CyberGym, a benchmark for evaluating cybersecurity capabilities.
Learn more
Pricing
Starting Price:
Free
Pricing Details:
Open source
Free Version:
Free Version available.
Integrations
No integrations listed.
Company Information
Apple
Founded: 1976
United States
github.com/apple/ml-ferret
Other Useful Business Software
MongoDB Atlas runs apps anywhere
MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Product Details
Platforms Supported
Cloud
Training
Documentation