Search Results for "usb device server"
Sort By:
Showing 35 open source projects for "usb device server"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
MCP Server Simulator iOS IDB
Enables LLMs to interact with iOS simulators
The MCP Server Simulator for iOS IDB provides a bridge between Large Language Models (LLMs) and iOS simulators, offering comprehensive control through natural language commands. It enables operations such as launching apps, interacting with the UI, and retrieving device information, enhancing the capabilities of AI-driven development tools. -
2
mistral.rs
Fast, flexible LLM inference
mistral.rs is a fast and flexible LLM inference engine implemented in Rust, designed to run and serve modern language models with an emphasis on performance and practical deployment. It provides multiple entry points for developers, including a CLI for running models locally and an HTTP server that exposes an OpenAI-compatible API surface for easy integration with existing clients. The project includes hardware-aware tooling that can benchmark a system and choose sensible quantization and device-mapping strategies, helping users get strong performance without manual tuning. It also supports serving multiple models from the same server process, enabling routing or quick switching between models depending on workload needs. ... -
3
MimiClaw
Run OpenClaw on a $5 chip
MimiClaw (from the mimiclaw project) is an edge-AI personal assistant that runs directly on extremely low-cost hardware like an ESP32-S3 microcontroller without a full operating system, Node.js, or cloud backend. By running pure C on a bare-metal chip, MimiClaw brings AI interactions and persistent memory to a tiny USB-powered device you can carry in your pocket. You connect the device to Wi-Fi and chat with it using Telegram, making it a convenient always-on assistant for tasks like reminders, quick lookups, or custom AI interactions. Even though it’s running on minimal hardware, MimiClaw maintains local memory that persists across power cycles, enabling context continuity over time without relying on cloud services. ... -
4
Codex Mobile
Run Codex Mobile Anywhere: Linux, Windows, or Termux on Android
Codex Mobile is a lightweight bridge that exposes Codex app-server workflows through a browser-accessible interface. It is designed to let users run a Codex-style UI on Linux, Windows, or Termux-powered Android setups. The project starts a local web server with one command, then lets the user open the interface from the same machine, a LAN device, or another reachable connection. It can also create a Cloudflare tunnel by default, making remote access easier when the local setup allows it. ... -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
5
5ire
5ire is a cross-platform desktop AI assistant, MCP client
5ire is a sleek, cross‑platform desktop AI assistant and MCP client that connects to major service providers, supports a local knowledge base and tool integration via MCP servers, enabling robust RAG and assistant features. These components are required as they constitute the runtime environment for the MCP Server. If you don't anticipate using the tools feature immediately, you may choose to skip this installation step and complete it later when the need arises. MCP is an open protocol that standardizes how applications provide context to LLMs. Think of MCP like a USB-C port for AI applications. Just as USB-C provides a standardized way to connect your devices to various peripherals and accessories, MCP provides a standardized way to connect AI models to different data sources and tools. -
6
WhisperLive
A nearly-live implementation of OpenAI's Whisper
WhisperLive is a “nearly live” implementation of OpenAI’s Whisper model focused on real-time transcription. It runs as a server–client system in which the server hosts a Whisper backend and clients stream audio to be transcribed with very low delay. The project supports multiple inference backends, including Faster-Whisper, NVIDIA TensorRT, and OpenVINO, allowing you to target GPUs and different CPU architectures efficiently. It can handle microphone input, pre-recorded audio files, and... -
7
OpenJarvis
Personal AI, On Personal Devices
OpenJarvis is an open-source framework designed to build personal AI agents that run primarily on local devices rather than relying on cloud infrastructure. Developed as part of the Intelligence Per Watt research initiative, it focuses on improving the efficiency and practicality of on-device AI systems. The framework provides shared primitives for building local-first agents, along with evaluation tools that measure performance using metrics such as energy consumption, latency, cost, and... -
8
QMD
mini cli search engine for your docs, knowledge bases, etc.
QMD is a powerful and lightweight command-line tool that acts as an on-device search engine for your personal knowledge base, allowing you to index and search files like Markdown notes, meeting transcripts, technical documentation, and other text collections without depending on cloud services. Designed to keep all search activity local, it combines classic full-text search techniques with modern semantic features such as vector similarity and hybrid ranking so that queries return not just... -
9
Telegram SMS
An SMS-forwarding Robot Running on Your Android Device
With the power of Telegram SMS, your multi-phone life is much easier than before. Receiving and sending SMS, relaying APP notifications, monitoring battery status. All stuff can be done with a single Telegram bot. You can use the bot in both private chat and group chat, in case you have more than 2 Android phones, or sharing the bot with other people. Telegram SMS connects with Telegram's bot API server directly, no 3rd-party services involved. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
Nexa SDK
Nexa SDK is a comprehensive toolkit for supporting ONNX and GGML
...It supports text generation, image generation, vision-language models (VLM), and speech-to-text (ASR), and text-to-speech (TTS) capabilities. Additionally, it offers an OpenAI-compatible API server with JSON schema mode for function calling and streaming support, and a user-friendly Streamlit UI. Users can run Nexa SDK in any device with Python environment, and GPU acceleration is supported, including CUDA, Metal, and ROCm. An executable version is also available. -
11
Gemma 4 Browser Assistant
On-device AI agent Chrome extension powered by Transformers.js
Gemma 4 Browser Assistant is an open-source browser extension that embeds an AI assistant directly into the browsing experience, powered by on-device machine learning models. It uses Transformers.js and Gemma models to run inference locally in the browser, eliminating the need for external servers and preserving user privacy. The extension includes a side panel interface that allows users to interact with the AI while browsing, enabling tasks such as summarizing pages and answering... -
12
Infinity
Low-latency REST API for serving text-embeddings
Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting all sentence-transformer models and frameworks. Infinity is developed under MIT License. Infinity powers inference behind Gradient.ai and other Embedding API providers. -
13
XcodeBuildMCP
A Model Context Protocol (MCP) server
XcodeBuildMCP is a Model Context Protocol server that exposes Xcode operations as typed tools and resources so AI assistants can build, test, and debug iOS apps programmatically. It’s organized with a modern plugin architecture and workflow-scoped tool directories, covering common developer actions across projects, schemes, targets, simulators, real devices, and Swift packages. The server aims to be “agent-ready,” surfacing capabilities (build, clean, test, archive, install, run, log... -
14
ort
Fast ML inference & training for ONNX models in Rust
...The library emphasizes speed and efficiency, leveraging hardware acceleration across CPUs, GPUs, and specialized accelerators to deliver low-latency inference both on-device and in server environments. One of its key strengths is its flexibility, as it supports multiple backends and allows developers to configure execution providers depending on available hardware. ort also includes advanced capabilities such as model compilation and optimization, reducing startup time and improving runtime performance in production systems. -
15
esp32-ai
Running a 28.9M parameter LLM on an $8 microcontroller
esp32-ai is an experimental language-model project that runs a 28.9-million-parameter model entirely on an ESP32-S3 microcontroller. The quantized model occupies about 14.9 MB and generates text without sending data to a server. Most parameters remain in flash through a Per-Layer Embeddings design, while active computation uses SRAM and PSRAM. This memory layout allows the device to retrieve only the embedding rows required for each token. The implementation reaches roughly 9.5 tokens per second and can display generated words on a connected screen. Trained on TinyStories, the model produces short, simple stories rather than answering questions, following instructions, or providing factual knowledge. ... -
16
wllama
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
wllama is a WebAssembly-based library that enables large language model inference directly inside a web browser. Built as a binding for the llama.cpp inference engine, the project allows developers to run LLM models locally without requiring a server backend or dedicated GPU hardware. The library leverages WebAssembly SIMD capabilities to achieve efficient execution within modern browsers while maintaining compatibility across platforms. By running models locally on the user’s device, wllama enables privacy-preserving AI applications that do not require sending data to remote servers. ... -
17
T3 Code
Minimal web GUI for coding agents
...Users need to install and authenticate at least one supported provider before using it, which keeps the actual agent accounts under the user’s control. The repository includes guidance for exposing a T3 Code server to another device, such as a phone, tablet, or separate desktop app. Overall, it is an early-stage developer tool for managing AI coding agents through a lightweight, session-oriented web interface. -
18
Jan.ai
Open source alternative to ChatGPT that runs 100% offline
Jan.ai is an open-source, privacy-focused AI assistant that serves as an alternative to ChatGPT, running completely locally on your device. It allows you to download and run LLMs (local language models) offline while also offering optional integration with cloud-based model providers—giving you full control over your data and AI interactions. Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace. Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral,... -
19
TensorFlow Lite for Microcontrollers
Infrastructure to enable deployment of ML models
...Its main value is bringing practical machine learning to edge devices that are too small for conventional mobile or server runtimes. -
20
Happy Coder
Mobile and Web client for Codex and Claude Code, with realtime voice
Happy is an open-source, cross-platform mobile and web client designed to bring powerful AI coding agents such as Claude Code and Codex to your fingertips no matter where you are. At its core, Happy wraps existing AI coding tools with a unified interface, providing real-time voice interactions, encrypted communication, and seamless device switching between desktop and mobile. You can start a coding session locally through the Happy CLI or connect from a phone or browser, allowing developers to inspect, interact with, and guide the AI as it generates, tests, or explains code. The project includes components like a dedicated backend server for encrypted sync, a rich front-end experience across web and native apps, and support for push notifications when your coding agent encounters permission requests or errors. ... -
21
HY-MT
Hunyuan Translation Model Version 1.5
HY-MT (Hunyuan Translation) is a high-quality multilingual machine translation model suite developed to support mutual translation across dozens of languages with strong performance even at smaller model scales. It ships with both an 1.8 B parameter model and a larger 7 B model, the latter optimized not only for direct translation but also for formatted and contextualized output, allowing better handling of terminology and mixed-language content. The project emphasizes both speed and... -
22
49 Agents IDE
Open-source 2D IDE for managing AI agents in native CLIs
49Agents is an open-source “agentic IDE” that reimagines how developers interact with multiple AI agents, terminals, and development environments by placing everything onto a single infinite, zoomable canvas. Instead of relying on traditional tab-based workflows, it provides a spatial interface where terminals, editors, Git views, and monitoring tools coexist as movable panes, enabling users to manage complex multi-agent systems visually and intuitively. The platform is designed to work... -
23
MLX-Audio
A text-to-speech, speech-to-text and speech-to-speech library
MLX-Audio is a speech library built on Apple’s MLX framework and optimized for Apple Silicon machines (M-series Macs). It focuses on text-to-speech and speech-to-speech workflows, with APIs and a command-line interface that make it easy to generate high-quality audio from text. Because it uses MLX and targets Apple Silicon, inference is fast and can take advantage of hardware acceleration and quantization for efficient on-device performance. The project provides a straightforward CLI... -
24
ElatoAI
Realtime AI Voice Agents with SoTA Multimodal AI models on Arduino ESP
ElatoAI is a real-time AI voice agent platform built around IoT hardware (ESP32) that enables continuous speech-to-speech conversations using state-of-the-art multimodal voice models with minimal latency and global performance via edge computing. The system integrates voice synthesis and recognition by connecting an ESP32 device through secure WebSockets to edge server functions written in Deno, allowing users to speak naturally with AI agents hosted through cloud APIs including OpenAI’s Realtime API, Gemini’s Live API, xAI’s Grok Voice Agent API, and others. It includes a web client (built with Next.js) for managing devices, controlling volume, and viewing conversation transcripts, while the hardware runs optimized firmware to deliver responses in near real time — even supporting >15-minute uninterrupted conversations. -
25
kolosal
Open Source and Lightweight Local LLM Platform
Kolosal AI is the leading open-source local LLM platform. Download, train, and run local LLM models on your device with no cloud dependencies. An opensource and lightweight alternative to LM Studio.
