Search Results for "scrolling"

...Screenshots of the mirrored window provide visual input, while Apple's Vision framework extracts visible text and tap-ready coordinates. macOS CGEvents supply taps, long presses, drags, scrolling, keyboard input, and iPhone Mirroring shortcuts. After performing an action, the agent captures the screen again to verify the actual resulting state. The harness can be installed as an agent skill for systems such as Claude Code or Codex. Its editable helper workspace also lets an agent create missing automation functions during execution.

MolmoWeb is an open-source multimodal web agent designed to autonomously navigate and interact with web browsers using vision-language models, representing a significant step toward fully agentic AI systems that can operate in real-world digital environments. The system takes natural language instructions and translates them into sequences of browser actions such as clicking, typing, scrolling, and navigating, effectively performing tasks on behalf of the user. Unlike traditional automation tools that rely on structured HTML parsing or predefined APIs, MolmoWeb operates directly from screenshots of web pages, interpreting visual content in the same way a human user would. This approach allows it to generalize across different websites without requiring site-specific integrations, making it highly adaptable to diverse web environments.

AskUI’s Vision Agent is an automation framework that allows you—and AI agents—to control real desktops, mobile devices, and HMI systems by perceiving the UI and performing actions like clicking, typing, scrolling, and drag-and-drop. It is designed for multi-platform compatibility and supports multiple AI models so you can tailor perception and decision-making to your workload. The repository presents a feature overview, sample media, and frequent release notes, which show ongoing improvements such as CORS checks and other operational tweaks. ...

The Star Ships Learning Framework (SSLF) provides basic routines and methods in order to interact with the space shooter Star Ships V2.1. It provides the necessary interfaces for controlling the program's ships and its logic from outside the game.

QtCritters is a simple critter simulation in C++ using Qt, currently under development. The goal of this project is to simulate a simple ecology of various kinds of animals, and to make the source easy to understand and modify. Still very very alpha...

TARILIO Pro platform for Information Retrieval that can work on a LAN as both client and LLM server. Advanced features: set LLM sampler parameters, scrolling index vocabulary, multilingual stemming, synonyms. MCP Client. UI can be translated using a free Language File Translator. Uses Llama Sharp and Lucene search engine . Open source and free. TARILIO PRO commercial version.