WhisperOpenAI
|
gpt-realtimeOpenAI
|
|||||
Related Products
|
||||||
About
We’ve trained and are open-sourcing a neural net called Whisper that approaches human-level robustness and accuracy in English speech recognition. Whisper is an automatic speech recognition (ASR) system trained on 680,000 hours of multilingual and multitask supervised data collected from the web. We show that the use of such a large and diverse dataset leads to improved robustness to accents, background noise, and technical language. Moreover, it enables transcription in multiple languages, as well as translation from those languages into English. We are open-sourcing models and inference code to serve as a foundation for building useful applications and for further research on robust speech processing. The Whisper architecture is a simple end-to-end approach, implemented as an encoder-decoder Transformer. Input audio is split into 30-second chunks, converted into a log-Mel spectrogram, and then passed into an encoder.
|
About
GPT-Realtime is OpenAI’s most advanced, production-ready speech-to-speech model, now accessible through the fully available Realtime API. It delivers remarkably natural, expressive audio with fine-grained control over tone, pace, and accent. The model can comprehend nuanced human audio, including laughter, switch languages mid-sentence, and accurately process alphanumeric details like phone numbers across multiple languages. It significantly improves reasoning and instruction-following (achieving 82.8% on the BigBench Audio benchmark and 30.5% on MultiChallenge) and boasts enhanced function calling, now more reliable, timely, and accurate (scoring 66.5% on ComplexFuncBench). The model supports asynchronous tool invocation so conversations remain fluid even during long-running calls. The Realtime API also offers innovative capabilities such as image input support, SIP phone network integration, remote MCP server connection, and reusable conversation prompts.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Anyone looking for a tool to recognize speech automatically and improve text transcription
|
Audience
Enterprises requiring a solution to build sophisticated, natural-sounding voice agents
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
$20 per month
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationOpenAI
United States
openai.com/blog/whisper/
|
Company InformationOpenAI
Founded: 2015
United States
openai.com/index/introducing-gpt-realtime/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
OpenAI
Azure AI Speech
Azure Model Catalog
Baseten
Bolna
Hyprnote
Monster API
Nekton.ai
NoteVocal
Pruna AI
|
Integrations
OpenAI
Azure AI Speech
Azure Model Catalog
Baseten
Bolna
Hyprnote
Monster API
Nekton.ai
NoteVocal
Pruna AI
|
|||||
|
|
|