Ferret

Ferret

Apple
+
+

Related Products

  • LTX
    182 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    1,161 Ratings
    Visit Website
  • Google AI Studio
    41 Ratings
    Visit Website
  • KrakenD
    76 Ratings
    Visit Website
  • DocketManager
    31 Ratings
  • AddSearch
    145 Ratings
    Visit Website
  • Budgyt
    291 Ratings
    Visit Website
  • ChatD&B
    Visit Website
  • SiteMinder
    700 Ratings
    Visit Website

About

An End-to-End MLLM that Accept Any-Form Referring and Ground Anything in Response. Ferret Model - Hybrid Region Representation + Spatial-aware Visual Sampler enable fine-grained and open-vocabulary referring and grounding in MLLM. GRIT Dataset (~1.1M) - A Large-scale, Hierarchical, Robust ground-and-refer instruction tuning dataset. Ferret-Bench - A multimodal evaluation benchmark that jointly requires Referring/Grounding, Semantics, Knowledge, and Reasoning.

About

LLaVA (Large Language-and-Vision Assistant) is an innovative multimodal model that integrates a vision encoder with the Vicuna language model to facilitate comprehensive visual and language understanding. Through end-to-end training, LLaVA exhibits impressive chat capabilities, emulating the multimodal functionalities of models like GPT-4. Notably, LLaVA-1.5 has achieved state-of-the-art performance across 11 benchmarks, utilizing publicly available data and completing training in approximately one day on a single 8-A100 node, surpassing methods that rely on billion-scale datasets. The development of LLaVA involved the creation of a multimodal instruction-following dataset, generated using language-only GPT-4. This dataset comprises 158,000 unique language-image instruction-following samples, including conversations, detailed descriptions, and complex reasoning tasks. This data has been instrumental in training LLaVA to perform a wide array of visual and language tasks effectively.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

AI and LLM developers

Audience

Researchers and anyone wanting a solution to generate and improve their AI-generated content

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Not Supported

API

Offers API Not Supported

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Open source
Free Version Supported
Free Trial Not Supported

Pricing

Free
Free Version Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Supported
In Person Not Supported

Company Information

Apple
Founded: 1976
United States
github.com/apple/ml-ferret

Company Information

LLaVA
llava-vl.github.io

Alternatives

Qwen3.5-Omni

Qwen3.5-Omni

Alibaba

Alternatives

PaliGemma 2

PaliGemma 2

Google
Qwen3.5

Qwen3.5

Alibaba
Falcon 2

Falcon 2

Technology Innovation Institute (TII)
Qwen3.7-Plus

Qwen3.7-Plus

Alibaba
Inkling

Inkling

Thinking Machines Lab

Categories

AI Models Supported
Multimodal Models Supported

Categories

AI Models Supported
AI Vision Models Supported
Multimodal Models Supported

Integrations

ExecuTorch Not Supported
GPT-4 Not Supported
LLaMA-Factory Not Supported

Integrations

ExecuTorch Supported
GPT-4 Supported
LLaMA-Factory Supported
Claim Ferret and update features and information
Claim Ferret and update features and information
Claim LLaVA and update features and information
Claim LLaVA and update features and information