Inworld Realtime STTInworld
|
gpt-4o-mini RealtimeOpenAI
|
|||||
Related Products
|
||||||
About
Inworld Realtime STT is a realtime streaming STT API that understands users beyond their words. It combines low-latency speech recognition with voice profiling, extracting emotion, vocal style, accent, age, and pitch directly from raw audio so downstream LLMs and TTS systems can respond with more adaptive, expressive behavior. Developers can stream audio in real time, transcribe complete files, or extract voice profile signals through one unified API, with realtime bidirectional streaming over WebSocket, synchronous transcription for full audio files, voice profile signals on every streaming chunk, and multi-provider support through a single model ID. Every audio chunk can produce a realtime profile of the speaker with confidence scores, giving LLMs structured context such as whether a user sounds sad, frustrated, soft, high-pitched, or calm.
|
About
The gpt-4o-mini-realtime-preview model is a compact, lower-cost, realtime variant of GPT-4o designed to power speech and text interactions with low latency. It supports both text and audio inputs and outputs, enabling “speech in, speech out” conversational experiences via a persistent WebSocket or WebRTC connection. Unlike larger GPT-4o models, it currently does not support image or structured output modalities, focusing strictly on real-time voice/text use cases. Developers can open a real-time session via the /realtime/sessions endpoint to obtain an ephemeral key, then stream user audio (or text) and receive responses in real time over the same connection. The model is part of the early preview family (version 2024-12-17), intended primarily for testing and feedback rather than full production loads. Usage is subject to rate limits and may evolve during the preview period. Because it is multimodal in audio/text only, it enables use cases such as conversational voice agents.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
AI teams building realtime assistants that need fast transcription, speaker context, multilingual support, and emotionally adaptive responses
|
Audience
Developers and teams in need of a tool to create voice agents or conversational applications with audio/text support and lower-cost models
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
Free
Free Version
Free Trial
|
Pricing
$0.60 per input
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationInworld
Founded: 2021
United States
inworld.ai/speech-to-text
|
Company InformationOpenAI
Founded: 2015
United States
platform.openai.com/docs/models/gpt-4o-mini-realtime-preview
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
GPT-4o
OpenAI
WebRTC
|
||||||
|
|
|