AudioCraftMeta AI
|
Inworld Realtime STTInworld
|
|||||
Related Products
|
||||||
About
AudioCraft is a single-stop code base for all your generative audio needs: music, sound effects, and compression after training on raw audio signals. With AudioCraft, we simplify the overall design of generative models for audio compared to prior work. Both MusicGen and AudioGen consist of a single autoregressive Language Model (LM) that operates over streams of compressed discrete music representation, i.e., tokens. We introduce a simple approach to leverage the internal structure of the parallel streams of tokens and show that, with a single model and elegant token interleaving pattern, our approach efficiently models audio sequences, simultaneously capturing the long-term dependencies in the audio and allowing us to generate high-quality audio. Our models leverage the EnCodec neural audio codec to learn the discrete audio tokens from the raw waveform. EnCodec maps the audio signal to one or several parallel streams of discrete tokens.
|
About
Inworld Realtime STT is a realtime streaming STT API that understands users beyond their words. It combines low-latency speech recognition with voice profiling, extracting emotion, vocal style, accent, age, and pitch directly from raw audio so downstream LLMs and TTS systems can respond with more adaptive, expressive behavior. Developers can stream audio in real time, transcribe complete files, or extract voice profile signals through one unified API, with realtime bidirectional streaming over WebSocket, synchronous transcription for full audio files, voice profile signals on every streaming chunk, and multi-provider support through a single model ID. Every audio chunk can produce a realtime profile of the speaker with confidence scores, giving LLMs structured context such as whether a user sounds sad, frustrated, soft, high-pitched, or calm.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Musicians, artists, and anyone looking for a tool to generate audio and sounds from written text
|
Audience
AI teams building realtime assistants that need fast transcription, speaker context, multilingual support, and emotionally adaptive responses
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
Free
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationMeta AI
Founded: 2004
United States
audiocraft.metademolab.com
|
Company InformationInworld
Founded: 2021
United States
inworld.ai/speech-to-text
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
No info available.
|
Integrations
No info available.
|
|||||
|
|
|