Search Results for "phone"

Phone Harness is a lightweight system that lets AI coding agents interact directly with a real iPhone through macOS iPhone Mirroring. It requires no jailbreak, Xcode project, WebDriverAgent, or custom software installed on the phone. Screenshots of the mirrored window provide visual input, while Apple's Vision framework extracts visible text and tap-ready coordinates. macOS CGEvents supply taps, long presses, drags, scrolling, keyboard input, and iPhone Mirroring shortcuts. ...

Open-AutoGLM is an open-source framework and model designed to empower autonomous mobile intelligent assistants by enabling AI agents to understand and interact with phone screens in a multimodal manner, blending vision and language capability to control real devices. It aims to create an “AI phone agent” that can perceive on-screen content, reason about user goals, and execute sequences of taps, swipes, and text input via automated device control interfaces like ADB, enabling hands-off completion of multi-step tasks such as navigating apps, filling forms, and more. ...

Hermes WebUI is a browser-based interface for interacting with the Hermes autonomous agent, providing full feature parity with its command-line experience. It offers a clean, multi-panel layout that includes chat interaction, session management, and workspace file browsing. The interface allows users to manage agent sessions, configure models, and interact with persistent memory systems directly from a web environment. It is built using simple technologies like Python and vanilla JavaScript,...

...It features a multi-agent architecture where different specialized agents can collaborate, delegate tasks, and operate in parallel. Flowly also includes voice capabilities, enabling real-time phone interactions using speech-to-text and text-to-speech systems. Overall, it provides a powerful, extensible, and privacy-focused alternative to cloud-based AI assistants.