Search Results for "local server"
Sort By:
Showing 54 open source projects for "local server"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Earn up to 16% annual interest with Nexo.Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
-
1
Local-NotebookLM
Googles NotebookLM but local
...It supports multiple LLM providers, including local and hosted options, and can be used through a command-line workflow, API server, Docker setup, or web UI. Overall, it is useful for students, researchers, and knowledge workers who want private, customizable audio summaries from documents. -
2
MCP Server DuckDB
A Model Context Protocol (MCP) server implementation for DuckDB
An MCP server implementation for DuckDB, providing database interaction capabilities through MCP tools, allowing operations like querying, table creation, and schema inspection. -
3
WhatsApp MCP Server
WhatsApp MCP server enabling AI access to chats and messaging
whatsapp-mcp is an open source Model Context Protocol (MCP) server that enables AI agents to interact directly with a user’s WhatsApp account through a structured interface. It acts as a bridge between WhatsApp and large language models, allowing controlled access to messages, chats, and contacts. whatsapp-mcp is composed of two main components: a Go-based bridge that connects to the WhatsApp Web API and stores data locally, and a Python-based MCP server that exposes tools for AI interaction. ... -
4
Chatterbox TTS Server
Self-host the powerful Chatterbox TTS model
Chatterbox-TTS-Server is a self-hosted server for running the Chatterbox text-to-speech model through both a web interface and API endpoints. It is designed for users who want local or private speech generation without depending entirely on a hosted voice platform. The project supports predefined voices, voice cloning, and longer text workflows, making it useful for audiobooks, narration, content tools, and assistant-style applications. -
One Monitoring Tool for IT, OT and Cloud | Free TrialModern infrastructure spans data centers, cloud platforms and factory floors, and every blind spot between them is a risk. PRTG supports SNMP, WMI, SSH and other standard protocols to monitor IT, OT and hybrid environments through one customizable dashboard. Build the views your team needs, from network health to application performance, without switching tools. Try PRTG free for 30 days now.
-
5
Lemonade
Lemonade helps users run local LLMs with the highest performance
Lemonade is a local LLM runtime that aims to deliver the highest possible performance on your own hardware by auto-configuring state-of-the-art inference engines for both NPUs and GPUs. The project positions itself as a “local LLM server” you can run on laptops and workstations, abstracting away backend differences while giving you a single place to serve and manage models. -
6
OpenJarvis
Personal AI, On Personal Devices
OpenJarvis is an open-source framework designed to build personal AI agents that run primarily on local devices rather than relying on cloud infrastructure. Developed as part of the Intelligence Per Watt research initiative, it focuses on improving the efficiency and practicality of on-device AI systems. The framework provides shared primitives for building local-first agents, along with evaluation tools that measure performance using metrics such as energy consumption, latency, cost, and... -
7
Bonsai 27B
Run Bonsai (1-bit) and Ternary-Bonsai language models locally
...They also provide OpenAI-compatible tool calling and optional MCP server integration for agentic workflows. Automated setup scripts install dependencies, download models, obtain binaries, and configure interactive interfaces. Users can access the models through command-line prompts, a local chat server, or Open WebUI. -
8
mcpo
A simple, secure MCP-to-OpenAPI proxy server
mcpo is a minimal bridge that exposes any MCP tool as an OpenAPI-compatible HTTP server. Instead of writing glue code, you point mcpo at an MCP server command and it generates REST endpoints and an OpenAPI spec that other systems (or LLM agent frameworks) can call immediately. This design lets you reuse a growing library of MCP servers with platforms that only understand HTTP+OpenAPI, unifying tool access across ecosystems. -
9
ODS
Turn your PC, Mac, or Linux box into an AI server.
ODS, or Osmantic Deployment System, turns a Windows, macOS, or Linux computer into a private AI server. Its installer detects available hardware, selects an appropriate local model, generates credentials, and launches a prewired service stack. The platform combines local model inference with a browser chat interface and a dashboard for managing models, services, GPUs, and extensions. It also integrates agents, voice, workflows, RAG, private search, and image generation. ... -
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
10
Colab-MCP
An MCP server for interacting with Google Colab
...This approach bridges the gap between local AI agents and remote high-performance compute environments, allowing users to offload heavy workloads such as machine learning training, data analysis, and dependency-heavy tasks to Colab’s GPU and TPU resources. By exposing Colab as an MCP server, the tool enables seamless integration with a wide range of AI assistants and agent frameworks, creating a standardized interface for tool use and execution. -
11
web-eval-agent MCP Server
An MCP server that autonomously evaluates web applications
...Marketing and README material emphasize supercharging local debugging loops by combining live browser execution with LLM-driven hypotheses and fixes. Activity on the repo shows steady iteration, with issues and PRs centered on reliability and developer experience. In short, it wraps autonomous, in-editor web testing and diagnosis behind a predictable MCP interface. -
12
Invisible Playwright MCP
Playwright MCP server undetected by anti-bots and captchas
Invisible Playwright MCP is an open-source browser automation agent that gives AI assistants control of a real Firefox-based browser through MCP. It can navigate pages, click controls, type text, select options, read page content, capture screenshots, and expose a live browser view. The underlying browser is a patched Firefox build whose identity settings are handled inside the engine rather than injected into individual pages. It can run from clients such as Claude Code, Codex, and Gemini... -
13
Windows Copilot API
Reverse engineered Windows Copilot into an OpenAI-compatible API
Windows Copilot API is an unofficial Python project that exposes the consumer Microsoft Copilot web experience through a programmable interface. It can be used directly as a Python library or launched as a local server compatible with the OpenAI API format. The client supports streamed responses, multi-turn conversations, and conversation identifiers. Browser-based sign-in stores a reusable session and refreshes it automatically for later requests. Because compatible applications can target the local endpoint, existing OpenAI SDK workflows require few changes. ... -
14
oMLX
LLM inference server with continuous batching & SSD caching
oMLX is a local LLM inference server optimized for Apple Silicon and managed from the macOS menu bar or command line. It serves text models, vision-language models, OCR models, embeddings, and rerankers through OpenAI- and Anthropic-compatible APIs. Continuous batching allows concurrent requests, while a tiered KV cache keeps active data in RAM and moves colder blocks to SSD for reuse. -
15
ChatGLM3
ChatGLM3 series: Open Bilingual Chat LLMs | Open Source Bilingual Chat
...It keeps the series’ smooth dialog and low deployment cost while adding native tool use (function calling), a built-in code interpreter, and agent-style workflows. The family includes base and long-context variants (8K/32K/128K). The repo ships Python APIs, CLI and web demos (Gradio/Streamlit), an OpenAI-format API server, and a compact fine-tuning kit. Quantization (4/8-bit), CPU/MPS support, and accelerator backends (TensorRT-LLM, OpenVINO, chatglm.cpp) enable lightweight local or edge deployment. -
16
Pocket TTS
A TTS that fits in your CPU (and pocket)
...Because it is CPU-oriented, it fits well in server environments where GPU access is limited, in desktop apps, or in edge deployments where simplicity matters more than maximum throughput. It also emphasizes developer ergonomics, providing a straightforward API surface that can be integrated into pipelines, assistants, accessibility tools, or batch generation scripts. -
17
MiniMax-MCP
Official MiniMax Model Context Protocol (MCP) server
...The server is written in Python and distributed under the MIT license, with a pyproject.toml and uv-based workflow that makes installation and execution reproducible. Configuration is handled through JSON files that tell MCP clients how to launch the server (typically via uvx minimax-mcp) and which environment variables to use for the API key, host, and output directory. -
18
WhisperLive
A nearly-live implementation of OpenAI's Whisper
WhisperLive is a “nearly live” implementation of OpenAI’s Whisper model focused on real-time transcription. It runs as a server–client system in which the server hosts a Whisper backend and clients stream audio to be transcribed with very low delay. The project supports multiple inference backends, including Faster-Whisper, NVIDIA TensorRT, and OpenVINO, allowing you to target GPUs and different CPU architectures efficiently. It can handle microphone input, pre-recorded audio files, and... -
19
gemini-web2api
Convert Google Gemini web into OpenAI-compatible API
...It is designed to let OpenAI-style clients connect to Gemini-like models through routes such as chat completions, models, responses, and native Gemini-compatible endpoints. The project can run as a simple local server and uses a mostly single-file design with an optional dependency for streaming. It supports model aliases for Flash, Thinking, Pro-style routing, Auto, and Lite variants. The tool also includes optional API keys, function calling, SSE streaming, web search access, Docker deployment, and client examples for OpenAI SDK-style usage. ... -
20
Reader 3
Quick illustration of how one can easily read books together with LLMs
This project is a minimalist, self-hosted EPUB reader designed to help users browse and read EPUB books one chapter at a time through a lightweight local server, making it especially easy to extract or work with chapters in external tools like large language models. It was created primarily as a simple demonstration of how to combine local book reading with LLM workflows without heavy dependencies or complicated setup, and it runs with just a small Python script and a basic HTTP server. -
21
LazyLLM
Easiest and laziest way for building multi-agent LLMs applications
LazyLLM is an optimized, lightweight LLM server designed for easy and fast deployment of large language models. It is fully compatible with the OpenAI API specification, enabling developers to integrate their own models into applications that normally rely on OpenAI’s endpoints. LazyLLM emphasizes low resource usage and fast inference while supporting multiple models. -
22
ChatTTS webUI & API
A simple native web interface that uses ChatTTS to synthesize text
ChatTTS-ui is a local web interface and API wrapper around the ChatTTS speech synthesis system, designed to make advanced TTS models easy to use from a browser. It runs a small backend server (Python + Torch + ffmpeg) and exposes a simple webpage where you can type text, adjust parameters, and generate audio. The project supports Chinese, English, and mixed text with digits and control symbols, making it suitable for bilingual content and numerically heavy text like announcements or prompts. ... -
23
stt
Voice Recognition to Text Tool
...It leverages open-source speech models such as Faster-Whisper to recognize and transcribe human speech into plain text, structured JSON objects, or subtitle files with time codes, making it suitable for both personal and professional transcription tasks. The project is designed to be easy to deploy: you can run a local Python server that exposes an HTTP API for uploading audio/video files and retrieving transcriptions in different formats. It supports GPU acceleration if available, enabling faster processing on compatible hardware but still offers reliable performance on CPUs alone. -
24
LMCache
Supercharge Your LLM with the Fastest KV Cache Layer
LMCache is an extension layer for LLM serving engines that accelerates inference, especially with long contexts, by storing and reusing key-value (KV) attention caches across requests. Instead of rebuilding KV states for repeated or shared text segments, LMCache persists and retrieves them from multiple tiers—GPU memory, CPU DRAM, and local disk—then injects them into subsequent requests to reduce TTFT and increase throughput. Its design supports reuse beyond strict prefix matching and enables sharing across serving instances, improving efficiency under real multi-tenant traffic. The broader project includes examples, tests, a server component, and public posts describing cross-engine sharing and inter-GPU KV transfers. ... -
25
Google Antigravity SDK
Python library for building agents that leverages Google Antigravity
...The SDK includes a high-level Agent class for quick setup, as well as lower-level conversation and connection abstractions for more controlled workflows. It supports streaming responses, stateful sessions, custom Python tools, MCP server integration, hooks, policies, and event-driven triggers. The package relies on a compiled runtime binary distributed through platform-specific PyPI wheels, so installation from PyPI is required for normal use. Its main value is giving developers a structured Python framework for creating local, tool-using, multimodal, policy-controlled AI agents.
