TML-interaction-smallThinking Machines Lab
|
gpt-4o-mini RealtimeOpenAI
|
|||||
Related Products
|
||||||
About
TML-Interaction-Small is a real-time multimodal interaction model developed by Thinking Machines Lab to enable more natural and collaborative human-AI communication across audio, video, and text. Unlike traditional turn-based AI systems that rely on external scaffolding and delayed interactions, TML-Interaction-Small is designed around continuous micro-turn exchanges that allow the model to perceive, respond, listen, speak, and react simultaneously in real time. The model uses a time-aware architecture that processes 200ms interaction windows, enabling seamless interruptions, simultaneous speech, visual cue detection, and live collaborative workflows without requiring separate dialog management systems. TML-Interaction-Small supports capabilities such as real-time conversation, proactive interjections, live translation, visual monitoring, tool usage, browsing, and asynchronous reasoning through coordination with a background model.
|
About
The gpt-4o-mini-realtime-preview model is a compact, lower-cost, realtime variant of GPT-4o designed to power speech and text interactions with low latency. It supports both text and audio inputs and outputs, enabling “speech in, speech out” conversational experiences via a persistent WebSocket or WebRTC connection. Unlike larger GPT-4o models, it currently does not support image or structured output modalities, focusing strictly on real-time voice/text use cases. Developers can open a real-time session via the /realtime/sessions endpoint to obtain an ephemeral key, then stream user audio (or text) and receive responses in real time over the same connection. The model is part of the early preview family (version 2024-12-17), intended primarily for testing and feedback rather than full production loads. Usage is subject to rate limits and may evolve during the preview period. Because it is multimodal in audio/text only, it enables use cases such as conversational voice agents.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
AI researchers, developers, multimodal AI teams, enterprise AI platforms, robotics companies, conversational AI providers, and organizations building real-time human-AI collaboration systems
|
Audience
Developers and teams in need of a tool to create voice agents or conversational applications with audio/text support and lower-cost models
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
$0.60 per input
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationThinking Machines Lab
United States
thinkingmachines.ai/
|
Company InformationOpenAI
Founded: 2015
United States
platform.openai.com/docs/models/gpt-4o-mini-realtime-preview
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
GPT-4o
OpenAI
WebRTC
|
||||||
|
|
|