Agent S

Introducing the Gemini 2.5 Computer Use model, a specialized agent model built on top of Gemini 2.5 Pro’s visual reasoning capabilities, designed to interact directly with user interfaces (UIs). It is exposed via a new computer-use tool in the Gemini API, with inputs that include the user’s request, a screenshot of the UI environment, and a history of recent actions. The model generates function calls corresponding to UI actions like clicking, typing, or selecting, and may request user confirmation for higher-risk tasks. After each action is executed, a new screenshot and URL are fed back into the model to continue the loop until the task completes or is halted. It is optimized primarily for web browser control and shows promise for mobile UI interaction, though it is not yet suited for desktop OS-level control. In benchmarks across web and mobile control tasks, Gemini 2.5 Computer Use outperforms leading alternatives, delivering high accuracy at lower latency.

Lux is a powerful computer-use AI platform that enables agents to operate software just like a human user—clicking, typing, navigating, and completing tasks across any interface. It offers three execution modes—Tasker, Actor, and Thinker—giving developers the ability to choose between step-by-step precision, near-instant task execution, or long-form reasoning for complex workflows. Lux can autonomously perform actions such as crawling Amazon data, running automated QA tests, or extracting insights from Nasdaq’s insider activity pages. The platform makes it possible to prototype and deploy real computer-use agents in as little as 20 minutes using developer-friendly SDKs and templates. Its agents are built to understand vague goals, execute long-running operations, and interact naturally with human-facing software instead of relying solely on APIs. Lux represents a new paradigm where AI goes beyond reasoning and content generation to directly operate computers at scale.