Orpheus TTSCanopy Labs
|
Voxtral Mini TTS 3.0Mistral AI
|
|||||
Related Products
|
||||||
About
Canopy Labs has introduced Orpheus, a family of state-of-the-art speech large language models (LLMs) designed for human-level speech generation. These models are built on the Llama-3 architecture and are trained on over 100,000 hours of English speech data, enabling them to produce natural intonation, emotion, and rhythm that surpasses current state-of-the-art closed source models. Orpheus supports zero-shot voice cloning, allowing users to replicate voices without prior fine-tuning, and offers guided emotion and intonation control through simple tags. The models achieve low latency, with approximately 200ms streaming latency for real-time applications, reducible to around 100ms with input streaming. Canopy Labs has released both pre-trained and fine-tuned 3B-parameter models under the permissive Apache 2.0 license, with plans to release smaller models of 1B, 400M, and 150M parameters for use on resource-constrained devices.
|
About
Voxtral Mini TTS 3.0 is Mistral AI's text-to-speech model for developers building voice-enabled applications and services. It generates speech from text in batch and real-time workflows, with preset or cloned voices, emotion and pace controls, and custom pronunciation. The model supports multilingual speech generation and dialect adaptation, making it suitable for conversational audio, localized content, spoken responses, and voice agents. Developers can access speech generation and voice-cloning capabilities through Mistral's API. Voxtral Mini TTS 3.0 is also part of Mistral's Voxtral 3 voice-agent stack, which combines speech recognition, reasoning, tool use, and generated speech; the Voxtral 3 stack can be self-deployed on customer infrastructure.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
Researchers needing a solution offering high-quality, low-latency speech synthesis with customizable voice cloning and emotion control capabilities
|
Audience
Developers and organizations building applications or services that generate speech, including voice-enabled products and voice agents.
|
|||||
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
|||||
API
Offers API
Not Supported
|
API
Offers API
Supported
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Not Supported
Free Trial
Supported
|
Pricing
$13/1M chars
Speech generation costs $13 per 1 million characters.
Free Version
Not Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Supported
In Person
Not Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationCanopy Labs
United States
canopylabs.ai/model-releases
|
Company InformationMistral AI
Founded: 2023
France
docs.mistral.ai/models/voxtral-mini-tts-3-0
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
Baseten
Supported
GitHub
Supported
Google Colab
Supported
Hugging Face
Supported
LiveKit
Not Supported
Llama 3
Supported
Mistral AI
Not Supported
VoiSpark
Supported
|
Integrations
Baseten
Not Supported
GitHub
Not Supported
Google Colab
Not Supported
Hugging Face
Not Supported
LiveKit
Supported
Llama 3
Not Supported
Mistral AI
Supported
VoiSpark
Not Supported
|
|||||
|
|
|