GPT-Realtime-2.1OpenAI
|
Mercury 2Inception
|
|||||
Related Products
|
||||||
About
GPT-Realtime-2.1 is OpenAI’s reasoning model with tool use for low-latency voice agents and complex speech-to-speech workflows. It updates GPT-Realtime-2 with improved alphanumeric recognition, silence and noise handling, and interruption behavior, helping applications understand spoken code, manage imperfect audio, and respond more naturally when users pause or talk over the agent. Developers can configure reasoning effort to balance deeper thinking against latency and output usage, while strong instruction following helps the model stay aligned with a defined role, tone, and workflow. It accepts and produces both audio and text, can take images as input, and supports function calling so an agent can retrieve information or perform actions during a conversation. The model has a 128,000-token context window, supports up to 32,000 output tokens, and includes reasoning-token support for extended interactions.
|
About
Mercury 2 is the first reasoning model fast enough to pick up the phone, a reasoning diffusion language model built for real-time voice agents. Instead of making callers wait through seconds of dead air while an autoregressive model generates thinking tokens one by one, Mercury 2 uses a diffusion large language model architecture to generate tokens in parallel, decoding 1000+ tokens per second on standard NVIDIA GPUs. That speed is fast enough to run a full reasoning pass and start speaking within the latency budget of a natural conversation, reducing the cost of reasoning from seconds of silence to roughly 300 milliseconds. Mercury models work by corrupting clean text into noise, then training a standard Transformer to reverse the process and predict clean text across all positions simultaneously. Because each denoising pass touches many tokens, generation uses the GPU more efficiently than one-token-at-a-time decoding, making custom-silicon-like speed possible on NVIDIA H100s.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Developers, AI agent builders, voice AI teams, contact center platforms, customer support teams, product teams, enterprise automation teams, and conversational AI companies that need realtime speech-to-speech interactions, audio input and output, function calling, tool use, configurable reasoning, image input, long-context voice workflows, transcription, translation, and interactive AI assistants
|
Audience
Voice AI infrastructure teams that need low-latency reasoning models for phone agents, tool-calling workflows, and natural customer conversations
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
$0.40 per cached input
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationOpenAI
Founded: 2015
United States
developers.openai.com/api/docs/models/gpt-realtime-2.1
|
Company InformationInception
United States
www.inceptionlabs.ai/blog/mercury-2-the-first-reasoning-model-fast-enough-to-pick-up-the-phone
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
OpenAI
Cerebras
GPT-4.1
Groq
Inception Labs
LiveKit
Pipecat
Retell AI
Vapi AI
gpt-realtime
|
Integrations
OpenAI
Cerebras
GPT-4.1
Groq
Inception Labs
LiveKit
Pipecat
Retell AI
Vapi AI
gpt-realtime
|
|||||
|
|
|