Search Results for "keyboard"
Sort By:
Showing 8 open source projects for "keyboard"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
UI-TARS Desktop
A GUI Agent app based on UI-TARS to control your computer using AI
...This cross-platform tool supports both Windows and macOS, allowing users to perform tasks through intuitive commands. Key features include screenshot-based visual recognition, precise mouse and keyboard control, and real-time feedback on actions. Provides immediate responses and visual feedback on actions performed. The application facilitates seamless interaction with the computer, enhancing user experience by simplifying complex operations into straightforward language instructions. Leverages advanced AI to bridge the gap between visual elements and language commands. ... -
2
Open Interface
Control Any Computer Using LLMs
Open Interface is a cross-platform application that allows users to control their computers using large language models (LLMs). By sending user requests to an LLM backend, it determines the necessary steps and executes them by simulating keyboard and mouse inputs. The system can adjust its actions based on real-time feedback, providing a self-driving computer experience. -
3
Maestro AI Orchestration
Agent Orchestration Command Center
Maestro is a cross-platform desktop application designed for power users to orchestrate and manage fleets of AI agents and project workflows from a keyboard-centric interface. It provides a high-performance experience for running multiple agent sessions in parallel, integrating with tools such as Claude Code, OpenAI Codex, and other agent tooling to automate tasks, perform unattended execution, and organize long-running work flows. Users can collaborate with AI to draft specifications, break tasks into playbooks, and run them sequentially or concurrently in isolated contexts, each with clean session history. ... -
4
Self-Operating Computer
A framework to enable multimodal models to operate a computer
The Self-Operating Computer Framework is an innovative system that enables multimodal models to autonomously operate a computer by interpreting the screen and executing mouse and keyboard actions to achieve specified objectives. This framework is compatible with various multimodal models and currently integrates with GPT-4o, o1, Gemini Pro Vision, Claude 3, and LLaVa. Notably, it was the first known project to implement a multimodal model capable of viewing and controlling a computer screen. The framework supports features like Optical Character Recognition (OCR) and Set-of-Mark (SoM) prompting to enhance visual grounding capabilities. ... -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
5
dsh-TUI
DSH official WeChat featured TUI plugin
...Users can resume, fork, compact, search, rewind, and switch models while preserving session history through DSH services. File references, image attachments, slash commands, questionnaires, and keyboard-driven input are built into the interface. Long conversations use event-driven rendering, virtualization, and bounded caches to control terminal and memory costs. The plugin also supports themes, MCP, skills, subagents, agent presets, and VS Code terminal workflows. -
6
Phone Harness
Let your agent control your phone
...Screenshots of the mirrored window provide visual input, while Apple's Vision framework extracts visible text and tap-ready coordinates. macOS CGEvents supply taps, long presses, drags, scrolling, keyboard input, and iPhone Mirroring shortcuts. After performing an action, the agent captures the screen again to verify the actual resulting state. The harness can be installed as an agent skill for systems such as Claude Code or Codex. Its editable helper workspace also lets an agent create missing automation functions during execution. -
7
GELab-Zero
GUI Exploration Lab. One of the best GUI agent solutions
GELab-Zero is an open-source “GUI Agent” framework aiming to automate interactions with graphical user interfaces (GUIs), combining both the agent model and all supporting infrastructure — including inference, input orchestration, and GUI automation logic — in a plug-and-play package that runs locally, without cloud dependencies. The idea is to let developers or users harness an AI agent that can simulate clicking, typing, reading UI elements, and interacting with apps in a human-like way... -
8
Universe Starter Agent
A starter agent that can solve a number of universe environments
...Its purpose is to serve as a baseline or reference implementation so researchers or developers can see how to build agents that operate in real-time, visual environments (e.g., games, browser apps) via pixel observations and keyboard/mouse actions. Under the hood, this starter agent implements a version of the A3C (Asynchronous Advantage Actor-Critic) algorithm, adapted for the specific challenges of Universe environments (e.g., network latency, VNC streaming, asynchronous observations). The repo includes modules like train.py, worker.py, model.py, a3c.py, and envs.py to support training, parallel worker management, policy/critics, and environment wrappers.
- Previous
- You're on page 1
- Next