MLX Serve
Native LLM inference server for Apple Silicon
MLX-Serve is a native AI inference server and desktop application for running open models locally on Apple Silicon Macs. Its Zig-based backend and Swift interface operate without requiring Python or a cloud account. It exposes OpenAI, Anthropic, and Ollama-compatible APIs for connecting development tools and AI applications. Users can download and manage models through a graphical interface, command-line tools, or a web console. Supported workflows include chat, coding assistance, image generation, video, music, speech, and 3D content generation. ...