Search Results for "android input device"
Sort By:
Showing 42 open source projects for "android input device"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Android Use
Automate native Android apps with AI using accessibility APIs
...The project works by using Android’s accessibility API to extract structured UI state (as XML) from the device, which is then fed to a large language model (LLM) like OpenAI’s models for decision-making, and actions are executed via the Android Debug Bridge (ADB). This approach bypasses expensive vision-based models and provides faster, cheaper automation with fine-grained interaction capabilities (for example, tapping buttons, typing text, navigating screens). -
2
Agent Development Kit (ADK)
Open-source, code-first Python toolkit for building, evaluating, etc.
ADK (Android Device Key) Python is a reference implementation by Google for working with Android attestation keys in Python. It facilitates the integration of Android attestation features into backends or systems that require verification of device identity and integrity. This is especially important in high-security applications where verifying that a device is genuine and uncompromised is critical. -
3
exo
Run your own AI cluster at home with everyday devices
Run your own AI cluster at home with everyday devices. Maintained by exo labs. Forget expensive NVIDIA GPUs, unify your existing devices into one powerful GPU, iPhone, iPad, Android, Mac, Linux, or pretty much any device. Now the default models, run 8B, 70B, and 405B parameter models on your own devices. -
4
firerpa LAMDA
The most powerful Android RPA agent framework
lamda is an Android RPA agent framework that provides visual remote desktop control and automation at scale, geared toward testing, automation validation, and device management. It exposes a clean UI to monitor and interact with connected devices and includes tooling to script actions reliably across apps and OS versions. The project emphasizes low-friction setup and powerful control primitives so teams can move from interactive validation to repeatable automation. -
Build Data Resilience - Take the Assessment TodayIs your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
-
5
Google AI Edge Gallery
A gallery that showcases on-device ML/GenAI use cases
Gallery is a curated collection of on-device machine learning examples, demo apps, and model artifacts designed to help developers experiment with and deploy ML at the edge. The project bundles runnable samples that show how to run TensorFlow Lite/Edge TPU models (and similar lightweight runtimes) on mobile and embedded platforms, demonstrating common tasks like image classification, object detection, audio recognition, and pose estimation. Each sample is intended to be both a learning aid... -
6
Open-AutoGLM
An open phone agent model & framework
Open-AutoGLM is an open-source framework and model designed to empower autonomous mobile intelligent assistants by enabling AI agents to understand and interact with phone screens in a multimodal manner, blending vision and language capability to control real devices. It aims to create an “AI phone agent” that can perceive on-screen content, reason about user goals, and execute sequences of taps, swipes, and text input via automated device control interfaces like ADB, enabling hands-off completion of multi-step tasks such as navigating apps, filling forms, and more. Unlike traditional automation scripts that depend on brittle heuristics, Open-AutoGLM uses pretrained large language and vision-language models to interpret visual context and natural language instructions, giving the agent robust adaptability across apps and interfaces. -
7
Telegram SMS
An SMS-forwarding Robot Running on Your Android Device
With the power of Telegram SMS, your multi-phone life is much easier than before. Receiving and sending SMS, relaying APP notifications, monitoring battery status. All stuff can be done with a single Telegram bot. You can use the bot in both private chat and group chat, in case you have more than 2 Android phones, or sharing the bot with other people. Telegram SMS connects with Telegram's bot API server directly, no 3rd-party services involved. -
8
Codex Mobile
Run Codex Mobile Anywhere: Linux, Windows, or Termux on Android
Codex Mobile is a lightweight bridge that exposes Codex app-server workflows through a browser-accessible interface. It is designed to let users run a Codex-style UI on Linux, Windows, or Termux-powered Android setups. The project starts a local web server with one command, then lets the user open the interface from the same machine, a LAN device, or another reachable connection. It can also create a Cloudflare tunnel by default, making remote access easier when the local setup allows it. Codex Mobile is useful for developers who want to control coding-agent sessions from a phone, tablet, remote browser, or nonstandard environment. ... -
9
Jev Chat Jarvis
Conversational co-pilot installed on mobile phone
...Local contacts, notes, and optional conversation history can provide additional context. Model endpoints are user-configurable, while screenshots used for OCR remain on the device. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
LiteRT
LiteRT, successor to TensorFlow Lite
LiteRT is Google's next-generation on-device machine learning framework and the successor to TensorFlow Lite, designed for high-performance AI and generative AI deployment across edge devices. It provides efficient model conversion, optimization, and runtime execution while leveraging hardware acceleration from CPUs, GPUs, and NPUs. LiteRT supports a wide range of platforms, including Android, iOS, Linux, macOS, Windows, web environments, and IoT devices. -
11
AndroidEnv
RL research on Android devices
android_env is a reinforcement learning (RL) environment developed by Google DeepMind that enables agents to interact with Android applications directly as a learning environment. It provides a standardized API for training agents to perform tasks on Android apps, supporting tasks ranging from games to productivity apps, making it suitable for research in real-world RL settings. -
12
SpeechRecognition
Speech recognition module for Python
Library for performing speech recognition, with support for several engines and APIs, online and offline. Recognize speech input from the microphone, transcribe an audio file, save audio data to an audio file. Show extended recognition results, calibrate the recognizer energy threshold for ambient noise levels (see recognizer_instance.energy_threshold for details). Listening to a microphone in the background, various other useful recognizer features. The easiest way to install this is using... -
13
Reins
Ollama client that simplifies experimenting with LLMs
Reins is a privacy-first, multi-platform AI client designed to simplify and enhance interaction with Ollama-based language models. It provides a highly customizable chat interface where users can configure system prompts, switch models dynamically, and adjust inference parameters such as temperature, token limits, and context size on a per-conversation basis. The application is built to run across platforms including mobile and desktop environments, making it accessible for a wide range of... -
14
Chatbox
The Ultimate AI Copilot on Your Desktop
Chatbox is a cross-platform desktop AI client designed to give you a fast, polished, and private way to work with modern language models. It runs locally on Windows, macOS, and Linux, keeping your conversations and data stored on your own device. Chatbox acts as a unified interface for popular LLMs like ChatGPT, Claude, Gemini, and local models via Ollama, making it easy to switch providers without changing tools. Built with an ergonomic UI, it’s optimized for long sessions, prompt... -
15
FluidVoice
Fastest macOS Offline Dictation app
FluidVoice is an open-source macOS dictation app that converts speech to text locally with optional AI enhancement. It is designed for fast, low-latency voice input across apps, with support for global hotkeys and direct text insertion. The app includes write mode for dictating or rewriting text in any text field and command mode for controlling Mac actions by voice. Its local enhancement layer can improve formatting, capitalization, and post-processing without sending data away from the... -
16
Rhino
On-device Speech-to-Intent engine powered by deep learning
Rhino is Picovoice's Speech-to-Intent engine. It directly infers intent from spoken commands within a given context of interest, in real-time. The end-to-end platform for embedding private voice AI into any software in a few lines of code. Design with no limits on top of a modular platform. Create use-case-specific voice AI models in seconds. Develop voice features with a few lines of code using intuitive and cross-platform SDKs. Deliver voice AI everywhere: on-device, mobile, web browsers,... -
17
CogAgent
An open sourced end-to-end VLM-based GUI Agent
CogAgent is a 9B-parameter bilingual vision-language GUI agent model based on GLM-4V-9B, trained with staged data curation, optimization, and strategy upgrades to improve perception, action prediction, and generalization across tasks. It focuses on operating real user interfaces from screenshots plus text, and follows a strict input–output format that returns structured actions, grounded operations, and optional sensitivity annotations. The model is designed for agent-style execution rather... -
18
Kitten TTS
State-of-the-art TTS model under 25MB
KittenTTS is an open-source, ultra-lightweight, and high-quality text-to-speech model featuring just 15 million parameters and a binary size under 25 MB. It is designed for real-time CPU-based deployment across diverse platforms. Ultra-lightweight, model size less than 25MB. CPU-optimized, runs without GPU on any device. High-quality voices, several premium voice options available. Fast inference, optimized for real-time speech synthesis. -
19
MAI-UI
Real-World Centric Foundation GUI Agents
...Developed by Tongyi-MAI (Alibaba’s research initiative), the MAI-UI models are multimodal agents trained to understand user instructions and corresponding screenshots, grounding those instructions to on-screen elements and generating sequences of GUI actions such as taps, swipes, text input, and system commands. Unlike traditional UI frameworks, MAI-UI emphasizes realistic deployment by supporting agent–user interaction (clarifying ambiguous instructions), integration with external tool APIs using MCP calls, and a device–cloud collaboration mechanism that dynamically routes computation to on-device or cloud models based on task state and privacy constraints. -
20
WhisperLive
A nearly-live implementation of OpenAI's Whisper
WhisperLive is a “nearly live” implementation of OpenAI’s Whisper model focused on real-time transcription. It runs as a server–client system in which the server hosts a Whisper backend and clients stream audio to be transcribed with very low delay. The project supports multiple inference backends, including Faster-Whisper, NVIDIA TensorRT, and OpenVINO, allowing you to target GPUs and different CPU architectures efficiently. It can handle microphone input, pre-recorded audio files, and... -
21
Omi
AI that sees your screen and listens to conversations
The Omi project is an open-source AI wearable ecosystem developed by Based Hardware that combines hardware, software, and cloud infrastructure to create a persistent “second brain” for capturing and processing real-world interactions. It is designed as a system that continuously listens to conversations and monitors screen activity, converting this input into structured data such as transcripts, summaries, and actionable insights in real time. The platform operates across multiple... -
22
OpenHealth
AI health assistant for private, local data-driven insights mgmt
OpenHealth is an AI-powered health assistant designed to help individuals take control of their personal health data and better understand their overall well-being. It works by aggregating various types of health information, such as clinical records, wearable device data, and self-reported inputs, into a unified and structured format. OpenHealth then uses large language models to enable contextual conversations, allowing users to interact with their own health data in a more intuitive and... -
23
ncnn
High-performance neural network inference framework for mobile
ncnn is a high-performance neural network inference computing framework designed specifically for mobile platforms. It brings artificial intelligence right at your fingertips with no third-party dependencies, and speeds faster than all other known open source frameworks for mobile phone cpu. ncnn allows developers to easily deploy deep learning algorithm models to the mobile platform and create intelligent APPs. It is cross-platform and supports most commonly used CNN networks, including... -
24
TorchMetrics
Machine learning metrics for distributed, scalable PyTorch application
...Metric arithmetic. Similar to torch.nn, most metrics have both a module-based and a functional version. The functional versions are simple python functions that as input take torch.tensors and return the corresponding metric as a torch.tensor. -
25
iMCP
A macOS app that provides an MCP server to your Messages
...It can provide controlled access to Calendar, Contacts, Location, Maps, Messages, Reminders, and Weather. The menu bar interface lets users enable individual services and approve the required macOS permissions. A bundled command-line server communicates over standard input and output with clients such as Claude Desktop, Claude Code, Cursor, and Amp. Calendar and reminder tools can create items, while other tools support searches, directions, travel estimates, message history, and current conditions. The app itself does not collect or store user data, although connected AI clients may send tool results off device. ...
