AudioCraftMeta AI
|
EmbeddingGemma 2Google
|
|||||
Related Products
|
||||||
About
AudioCraft is a single-stop code base for all your generative audio needs: music, sound effects, and compression after training on raw audio signals. With AudioCraft, we simplify the overall design of generative models for audio compared to prior work. Both MusicGen and AudioGen consist of a single autoregressive Language Model (LM) that operates over streams of compressed discrete music representation, i.e., tokens. We introduce a simple approach to leverage the internal structure of the parallel streams of tokens and show that, with a single model and elegant token interleaving pattern, our approach efficiently models audio sequences, simultaneously capturing the long-term dependencies in the audio and allowing us to generate high-quality audio. Our models leverage the EnCodec neural audio codec to learn the discrete audio tokens from the raw waveform. EnCodec maps the audio signal to one or several parallel streams of discrete tokens.
|
About
EmbeddingGemma 2 is an open, lightweight multimodal embedding model designed to map text, code, images, video, and audio into a shared embedding space for search, retrieval, classification, routing, and RAG applications. Built on the Gemma 4 architecture and released under the Apache 2.0 license, it has 740 million parameters and is optimized for on-device inference. Its modular design can use as little as 270M parameters for text-only workloads, with optional vision and audio encoders for full multimodal support. Matryoshka Representation Learning lets developers reduce output vectors from 768 dimensions to 512, 256, or 128, lowering storage and memory requirements for local vector databases. The model supports an 8K-token context window and can process up to 5.5 minutes of audio, 29 images, 58 video frames, or interleaved combinations on local hardware.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
Musicians, artists, and anyone looking for a tool to generate audio and sounds from written text
|
Audience
Developers and AI teams wanting to build private, efficient, on-device multimodal search, retrieval, RAG, and semantic indexing systems
|
|||||
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
|||||
API
Offers API
Not Supported
|
API
Offers API
Supported
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationMeta AI
Founded: 2004
United States
audiocraft.metademolab.com
|
Company InformationGoogle
Founded: 1998
United States
blog.google/innovation-and-ai/technology/developers-tools/embeddinggemma-2/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
No info available.
|
Integrations
No info available.
|
|||||
|
|
|