Orpheus TTSCanopy Labs
|
Realtime TTS-2Inworld
|
|||||
Related Products
|
||||||
About
Canopy Labs has introduced Orpheus, a family of state-of-the-art speech large language models (LLMs) designed for human-level speech generation. These models are built on the Llama-3 architecture and are trained on over 100,000 hours of English speech data, enabling them to produce natural intonation, emotion, and rhythm that surpasses current state-of-the-art closed source models. Orpheus supports zero-shot voice cloning, allowing users to replicate voices without prior fine-tuning, and offers guided emotion and intonation control through simple tags. The models achieve low latency, with approximately 200ms streaming latency for real-time applications, reducible to around 100ms with input streaming. Canopy Labs has released both pre-trained and fine-tuned 3B-parameter models under the permissive Apache 2.0 license, with plans to release smaller models of 1B, 400M, and 150M parameters for use on resource-constrained devices.
|
About
Realtime TTS-2 from Inworld AI is a new generation of voice model built for real-time conversation: a voice model that feels as human as it sounds. It hears the full audio of an exchange, picks up the user’s tone, pacing, and emotional state, then takes voice direction in plain English, the way developers prompt an LLM. Instead of generating speech in isolation, it listens to prior turns of the exchange, so tone and pacing carry forward, and the same line can land differently after a joke than after bad news. Voice Direction lets developers steer delivery like a director would steer a voice actor, using natural-language descriptions rather than fixed emotion presets or sliders. Inline nonverbals like [sigh], [breathe], and [laugh] can be placed inside the text, and the model renders them as audio events. Realtime TTS-2 preserves one voice identity across more than 100 languages, including mid-utterance language switches.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Researchers needing a solution offering high-quality, low-latency speech synthesis with customizable voice cloning and emotion control capabilities
|
Audience
Voice AI developers building realtime agents, characters, tutors, support systems, and companions that need emotionally aware, multilingual, humanlike speech
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
$25 per month
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationCanopy Labs
United States
canopylabs.ai/model-releases
|
Company InformationInworld
Founded: 2021
United States
inworld.ai/blog/realtime-tts-2
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
Baseten
ChatGPT
Claude
Gemini
GitHub
Google Colab
Grok
Hugging Face
Llama 3
Perplexity
|
Integrations
Baseten
ChatGPT
Claude
Gemini
GitHub
Google Colab
Grok
Hugging Face
Llama 3
Perplexity
|
|||||
|
|
|