Vision Agents
Vision Agents is an open source Python framework for building low-latency voice and video AI agents with any model. It lets developers plug in LLM, speech, and vision models from more than 25 providers and ship real-time agents for telehealth, voice support, live coaching, video analysis, interactive avatars, security monitoring, sports commentary, and other multimodal applications. It is designed to help teams build agents that can listen, speak, see, process media, call tools, and respond in real time while running on Stream’s global edge network with sub-500ms latency. Developers can build a first agent in minutes, using a small Python setup with Gemini Realtime, OpenAI, Deepgram, ElevenLabs, Stream, or other supported providers. Vision Agents supports both real-time speech-to-speech models and custom STT/LLM/TTS pipelines, giving teams either the fastest path to a working voice agent or full control over speech recognition, language reasoning, text-to-speech, etc.
Learn more
Retell AI
Retell AI is an advanced platform that enables businesses to build, test, deploy, and monitor AI-powered voice agents for seamless customer interactions. With features like call transfer, appointment scheduling, and knowledge base synchronization, it allows for the creation of lifelike conversations with minimal latency. The platform supports integration with various telephony systems and offers multilingual capabilities, making it suitable for global operations. Retell AI's scalable infrastructure ensures reliable performance, handling high call volumes efficiently. Additionally, it provides robust monitoring tools to analyze call performance and user sentiment, facilitating continuous improvement of voice agents.
Learn more
Gemini Audio
Gemini Audio is a set of advanced real-time audio models built on Gemini's architecture, designed to enable natural, fluid voice interaction and expressive audio generation through simple language prompts. It supports conversational experiences where users can speak, listen, and interact with AI in a seamless loop, combining understanding, reasoning, and response generation in audio form. It is capable of both analyzing and generating audio, allowing applications such as speech-to-text transcription, translation, speaker identification, emotion detection, and detailed audio content analysis. They are optimized for low-latency, real-time use cases, making them suitable for live assistants, voice agents, and interactive systems that require continuous, multi-turn dialogue. Gemini Audio also integrates advanced capabilities like function calling, enabling the model to trigger external tools and incorporate real-time data into responses.
Learn more
Telnyx
Telnyx is a global communications infrastructure platform that provides voice, messaging, networking, and AI-powered real-time communication capabilities through a fully owned telecom stack. The platform combines carrier-grade networking, programmable identity systems, AI inference, and low-latency communication infrastructure to support real-time conversational AI agents and enterprise communication workflows. Telnyx owns and operates its entire network stack, including physical infrastructure, mobile core systems, edge processing, and AI compute layers, enabling faster performance and lower latency without relying on third-party telecom providers. The platform offers tools such as voice agent builders, speech-to-text, text-to-speech, global phone numbers, AI orchestration, and programmable compliance controls for building intelligent voice and messaging systems.
Learn more
