Search Results for "server local"
Sort By:
Showing 138 open source projects for "server local"
View related business solutions-
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
Local-NotebookLM
Googles NotebookLM but local
...It supports multiple LLM providers, including local and hosted options, and can be used through a command-line workflow, API server, Docker setup, or web UI. Overall, it is useful for students, researchers, and knowledge workers who want private, customizable audio summaries from documents. -
2
Last9 MCP Server
Last9 MCP Server
The Last9 MCP Server is a Model Context Protocol server implementation for Last9, enabling AI agents to seamlessly bring real-time production context—logs, metrics, and traces—into local environments to auto-fix code faster. -
3
mcp-server-chatsum
Query and Summarize your chat messages
mcp-server-chatsum is an MCP server that indexes your chat history and provides tools to query and produce focused summaries on demand. It offers a simple flow: point the server at a local chat database, run the companion chatbot to ingest messages, and then use the MCP tool to retrieve scoped threads and generate concise syntheses. The tool design lets agents filter by participants, time ranges, or keywords before summarizing, which keeps outputs relevant and reduces hallucinated context. ... -
4
MCP Server DuckDB
A Model Context Protocol (MCP) server implementation for DuckDB
An MCP server implementation for DuckDB, providing database interaction capabilities through MCP tools, allowing operations like querying, table creation, and schema inspection. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
5
OpenVINO Model Server
A scalable inference server for models optimized with OpenVINO
OpenVINO™ Model Server is a high-performance inference serving system designed to host and serve machine learning models that have been optimized with the OpenVINO toolkit. It’s implemented in C++ for scalability and efficiency, making it suitable for both edge and cloud deployments where inference workloads must be reliable and high throughput. The server exposes model inference via standard network protocols like REST and gRPC, allowing any client that speaks those protocols to request predictions remotely, abstracting away the complexity of where and how the model runs. ... -
6
WhatsApp MCP Server
WhatsApp MCP server enabling AI access to chats and messaging
whatsapp-mcp is an open source Model Context Protocol (MCP) server that enables AI agents to interact directly with a user’s WhatsApp account through a structured interface. It acts as a bridge between WhatsApp and large language models, allowing controlled access to messages, chats, and contacts. whatsapp-mcp is composed of two main components: a Go-based bridge that connects to the WhatsApp Web API and stores data locally, and a Python-based MCP server that exposes tools for AI interaction. ... -
7
MCP Server Chart
A visualization mcp contains 25+ visual charts
...The README documents private deployment, record generation, and tool filtering, giving teams a path from local experimentation to managed usage. -
8
Chatterbox TTS Server
Self-host the powerful Chatterbox TTS model
Chatterbox-TTS-Server is a self-hosted server for running the Chatterbox text-to-speech model through both a web interface and API endpoints. It is designed for users who want local or private speech generation without depending entirely on a hosted voice platform. The project supports predefined voices, voice cloning, and longer text workflows, making it useful for audiobooks, narration, content tools, and assistant-style applications. -
9
Codex Mobile
Run Codex Mobile Anywhere: Linux, Windows, or Termux on Android
Codex Mobile is a lightweight bridge that exposes Codex app-server workflows through a browser-accessible interface. It is designed to let users run a Codex-style UI on Linux, Windows, or Termux-powered Android setups. The project starts a local web server with one command, then lets the user open the interface from the same machine, a LAN device, or another reachable connection. It can also create a Cloudflare tunnel by default, making remote access easier when the local setup allows it. ... -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
10
Lemonade
Lemonade helps users run local LLMs with the highest performance
Lemonade is a local LLM runtime that aims to deliver the highest possible performance on your own hardware by auto-configuring state-of-the-art inference engines for both NPUs and GPUs. The project positions itself as a “local LLM server” you can run on laptops and workstations, abstracting away backend differences while giving you a single place to serve and manage models. -
11
ds4.c
DeepSeek 4 Flash local inference engine for Metal
ds4.c is a specialized local inference engine created by antirez for running DeepSeek V4 Flash models directly on Apple Silicon hardware using Metal acceleration. Unlike general-purpose inference runtimes, the project is intentionally optimized for a specific model family, enabling highly efficient execution and simplified architecture. The engine includes DS4-specific model loading, KV cache management, prompt rendering, and OpenAI-compatible server APIs for local deployment workflows. ... -
12
OpenJarvis
Personal AI, On Personal Devices
OpenJarvis is an open-source framework designed to build personal AI agents that run primarily on local devices rather than relying on cloud infrastructure. Developed as part of the Intelligence Per Watt research initiative, it focuses on improving the efficiency and practicality of on-device AI systems. The framework provides shared primitives for building local-first agents, along with evaluation tools that measure performance using metrics such as energy consumption, latency, cost, and... -
13
Bonsai 27B
Run Bonsai (1-bit) and Ternary-Bonsai language models locally
...They also provide OpenAI-compatible tool calling and optional MCP server integration for agentic workflows. Automated setup scripts install dependencies, download models, obtain binaries, and configure interactive interfaces. Users can access the models through command-line prompts, a local chat server, or Open WebUI. -
14
AingDesk
AI assistant that supports knowledge bases, model APIs
AingDesk is an open-source desktop and server-based AI assistant platform designed to provide a user-friendly environment for interacting with language models and building AI-powered tools. The software enables users to run local AI models or connect to external model APIs through a unified interface. One of its primary goals is to simplify the process of building knowledge-based assistants by allowing users to create local knowledge bases that the AI can search and analyze. ... -
15
Lucebox
Fast LLM speculative inference server for consumer hardware
Lucebox is a local LLM inference server built for fast generation on consumer hardware. It focuses on custom kernels, speculative prefill, speculative decoding, and model-specific optimizations rather than a generic one-size-fits-all runtime. The project includes a native C++ HTTP server with an OpenAI-compatible API, making it usable with tools that already speak the Chat Completions format. -
16
ODS
Turn your PC, Mac, or Linux box into an AI server.
ODS, or Osmantic Deployment System, turns a Windows, macOS, or Linux computer into a private AI server. Its installer detects available hardware, selects an appropriate local model, generates credentials, and launches a prewired service stack. The platform combines local model inference with a browser chat interface and a dashboard for managing models, services, GPUs, and extensions. It also integrates agents, voice, workflows, RAG, private search, and image generation. ... -
17
shimmy
Python-free Rust inference server
The shimmy project is a lightweight local inference server designed to run large language models with minimal overhead. Written primarily in Rust, the tool provides a small standalone binary that exposes an API compatible with the OpenAI interface, allowing existing applications to interact with local models without significant code changes. This compatibility enables developers to replace remote AI services with locally hosted models while keeping their existing software architecture intact. ... -
18
CodexPro
Use ChatGPT Developer Mode as a local coding agent for your repo
CodexPro is a local MCP bridge that lets ChatGPT Developer Mode work inside a specific code repository. It starts a local server for the current workspace so ChatGPT can read files, search code, apply scoped edits, run guarded shell checks, and review changes. The project is designed around local control rather than hosting code or proxying model access through a third-party service. -
19
Groq Desktop
Local Groq Desktop chat app with MCP support
Groq Desktop is a cross-platform (Windows / macOS / Linux) local desktop application that provides a graphical chat interface for interacting with Groq-hosted, function-call-capable models. It bundles a built-in MCP (Model Context Protocol) server enabling smart function calling, letting users chat with an AI, send images, or interact with richer multimodal inputs — all from a friendly desktop UI. -
20
mcpo
A simple, secure MCP-to-OpenAPI proxy server
mcpo is a minimal bridge that exposes any MCP tool as an OpenAPI-compatible HTTP server. Instead of writing glue code, you point mcpo at an MCP server command and it generates REST endpoints and an OpenAPI spec that other systems (or LLM agent frameworks) can call immediately. This design lets you reuse a growing library of MCP servers with platforms that only understand HTTP+OpenAPI, unifying tool access across ecosystems. -
21
OpenMonoAgent
Terminal-native coding agent powered by local LLMs
OpenMonoAgent.ai is a self-hosted coding agent designed to run entirely on the user’s own hardware. It pairs a .NET CLI with a local llama.cpp inference server so developers can use agentic coding workflows without cloud subscriptions or per-token billing. The project emphasizes privacy, local control, and ownership of the model, compute, and project data. It includes a terminal-native workflow, built-in tools, Docker sandboxing, and code intelligence features. ... -
22
kMCP
Kubernetes Controller for building, testing and deploying MCP servers
KMCP is a companion toolchain for building, testing, and deploying MCP servers with a workflow that spans local development through Kubernetes production deployments. It includes a CLI for day-to-day development tasks like scaffolding new MCP projects, managing tools, building container images, and running an MCP server locally for validation. For cluster operations, it includes a Kubernetes controller that manages MCP server lifecycles using a dedicated Custom Resource Definition (CRD), allowing MCP servers to be represented as native Kubernetes objects you can operate with familiar kubectl-driven patterns. ... -
23
baoyu-design
Run Claude Design locally as an Agent Skill
baoyu-design is an Agent Skill that lets local coding agents produce polished visual design artifacts. It packages Claude Design-style methodology for environments such as Cursor, Claude Code, Codex, Claude Desktop, and other file-capable agents. The skill can generate UI mockups, prototypes, wireframes, landing pages, dashboards, mobile app screens, and slide decks as self-contained HTML. It keeps outputs inside the local project, so artifacts can be versioned, edited, previewed, and... -
24
mistral.rs
Fast, flexible LLM inference
mistral.rs is a fast and flexible LLM inference engine implemented in Rust, designed to run and serve modern language models with an emphasis on performance and practical deployment. It provides multiple entry points for developers, including a CLI for running models locally and an HTTP server that exposes an OpenAI-compatible API surface for easy integration with existing clients. The project includes hardware-aware tooling that can benchmark a system and choose sensible quantization and... -
25
Shadcn UI v4 MCP Server
A mcp server to allow LLMS gain context about shadcn ui component
...The server supports multiple frontend frameworks including React, Svelte, Vue, and React Native, making it highly versatile for cross-platform development. It includes smart caching and efficient GitHub API usage to optimize performance and handle rate limits during component retrieval. The system also supports multiple transport modes such as standard input/output and Server-Sent Events, enabling both local and distributed deployments.
