Alternatives to LocalAI

Compare LocalAI alternatives for your business or organization using the curated list below. SourceForge ranks the best alternatives to LocalAI in 2026. Compare features, ratings, user reviews, pricing, and more from LocalAI competitors and alternatives in order to make an informed decision for your business.

  • 1
    Aiko

    Aiko

    Aiko

    High-quality on-device transcription. Easily convert speech to text from meetings, lectures, and more. The transcription is powered by OpenAI's Whisper running locally on your device. The audio never leaves your device.
    Starting Price: Free
  • 2
    Note67

    Note67

    Note67

    Note67 is a privacy-centric meeting assistant designed for professionals who demand total control over their data. Unlike traditional transcription tools that rely on cloud processing, Note67 is an open-source, local-first application for macOS that captures audio, transcribes speech, and generates intelligent summaries entirely on your device. No audio or text ever leaves your machine, ensuring zero data leakage. Built with performance and security in mind, the application leverages the power of Rust and Tauri to deliver a lightweight, native experience. It integrates seamless local AI capabilities, utilizing Whisper for high-accuracy speech-to-text and Ollama for generating insightful meeting summaries using local Large Language Models (LLMs). Key Features: 100% Local Processing: Powered by on-device Whisper models, ensuring your audio and transcripts remain completely private.
  • 3
    QuickWhisper

    QuickWhisper

    IWT Pty Ltd

    QuickWhisper is a macOS application for transcription, dictation, and AI summarization using OpenAI's Whisper model. It runs entirely on-device with no cloud dependency required. The application transcribes audio from local files, YouTube videos, online meetings, and system audio. QuickWhisper can record meetings with calendar integration while keeping the recording interface hidden during screen sharing. System-wide dictation works across all macOS applications, replacing keyboard input with voice. All transcription runs on your Mac. AI summarization is available through cloud providers (OpenAI, Anthropic, Google, xAI, Mistral, Groq) or on-device via Ollama and LM Studio. QuickWhisper also includes batch transcription, Watch Folders for automatic background transcription, speaker diarization, Apple Shortcuts integration, and webhooks for third-party service integration.
    Starting Price: $39 one-time payment
  • 4
    xPrivo

    xPrivo

    xPrivo

    A free, open-source AI chat alternative to ChatGPT and Perplexity that prioritizes your privacy and anonymity. No account required – not even for PRO features. All chats are stored locally on your device and never logged or used for training. Key Features: - 100% Anonymous | Zero personal data collection - EU-hosted models - GDPR-compliant servers running Mistral 3, DeepSeek V3.2, and other powerful open-source models behind the default xprivo model - Web search with sources. Get fact-checked, current information - Self-hostable. Run it on your own infrastructure or use the hosted version - BYOK support. Connect your own API keys from OpenAI, Anthropic, Grok, etc. - Local-first. Your chat history never leaves your device - Open source. Fully auditable code on GitHub - Use it with ollama to chat with your local models fully offline Perfect for privacy-conscious users who want powerful AI assistance without compromising their anonymity.
  • 5
    Ai2 OLMoE

    Ai2 OLMoE

    The Allen Institute for Artificial Intelligence

    Ai2 OLMoE is a fully open source mixture-of-experts language model that is capable of running completely on-device, allowing you to try our model privately and securely. Our app is intended to help researchers better explore how to make on-device intelligence better and to enable developers to quickly prototype new AI experiences, all with no cloud connectivity required. OLMoE is a highly efficient mixture-of-experts version of the Ai2 OLMo family of models. Experience which real-world tasks state-of-the-art local models are capable of. Research how to improve small AI models. Test your own models locally using our open-source codebase. Integrate OLMoE into other iOS applications. The Ai2 OLMoE app provides privacy and security by operating completely on-device. Easily share the output of your conversations with friends or colleagues. The OLMoE model and the application code are fully open source.
    Starting Price: Free
  • 6
    Private Mind

    Private Mind

    Software Mansion

    Private Mind is an on-device AI assistant that works entirely offline, giving users local AI with total privacy. It is built around the belief that AI should live on the user’s device, with conversations, files, prompts, and data staying local instead of being sent to the cloud. Users can chat with the assistant without Wi-Fi, sign-ups, tracking, or cloud dependency, making it useful for planning trips, translating text, brainstorming ideas, analyzing data, learning new things, or getting help when internet access is unavailable. Private Mind supports chat with files, allowing users to interact with their own documents through on-device AI and intelligent retrieval without sending private material outside the device. It also includes speech-to-text, so users can speak naturally and get instant local transcriptions using Whisper. It supports multiple open-source AI models.
    Starting Price: Free
  • 7
    PyGPT

    PyGPT

    PyGPT

    PyGPT is an open source, personal desktop AI assistant for Linux, Windows, and Mac, written in Python. It works similarly to ChatGPT, but locally on a desktop computer, with chat, vision, agents, image and video generation, tools, voice control, and more. PyGPT supports multiple models, including OpenAI GPT-5, GPT-4, o1, o3, o4, Google Gemini, Anthropic Claude, xAI Grok, Perplexity Sonar, DeepSeek, Mistral AI, and models accessible through Ollama and LlamaIndex. It offers 12 modes of operation, including chat, chat with files, realtime + audio, research, completion, image and video generation, vision, assistants, experts, computer use, agents, and autonomous mode. Users can chat with their own files and data using integrated LlamaIndex support. PyGPT includes built-in vector database support, automated files and data embedding, full conversation context, short- and long-term memory, internet access through Google, Microsoft Bing, and DuckDuckGo, plus speech synthesis and recognition.
    Starting Price: Free
  • 8
    StarWhisper

    StarWhisper

    StarWhisper

    StarWhisper is free voice-to-text software for Windows that lets you dictate anywhere with AI-powered transcription. It works offline with local Whisper AI or connects to OpenAI for 99% accuracy. Features include 29+ languages, GPU acceleration, wake word activation, auto-paste, file transcription, and multiple AI models. A free tier (500 words/day) covers casual use, while Pro plans unlock unlimited transcription and all models. Key Features: - Offline transcription with local Whisper AI - GPU acceleration for fast processing - 29+ language support - Wake word activation - Auto-paste into any app - File transcription - Multiple AI model sizes - OpenAI API integration Use Cases: - Dictate documents and emails - Transcribe meeting recordings - Voice-driven coding and notes - Accessibility for users with mobility issues - Multi-language content creation
    Starting Price: $10
  • 9
    CodeGen

    CodeGen

    Salesforce

    CodeGen is an open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
    Starting Price: Free
  • 10
    MindMac

    MindMac

    MindMac

    MindMac is a native macOS application designed to enhance productivity by integrating seamlessly with ChatGPT and other AI models. It supports multiple AI providers, including OpenAI, Azure OpenAI, Google AI with Gemini, Gemini Enterprise Agent Platform, Anthropic Claude, OpenRouter, Mistral AI, Cohere, Perplexity, OctoAI, and local LLMs via LMStudio, LocalAI, GPT4All, Ollama, and llama.cpp. MindMac offers over 150 built-in prompt templates to facilitate user interaction and allows for extensive customization of OpenAI parameters, appearance, context modes, and keyboard shortcuts. The application features a powerful inline mode, enabling users to generate content or ask questions within any application without switching windows. MindMac ensures privacy by storing API keys securely in the Mac's Keychain and sending data directly to the AI provider without intermediary servers. The app is free to use with basic features, requiring no account for setup.
    Starting Price: $29 one-time payment
  • 11
    DevPromptAi

    DevPromptAi

    DevPromptAi

    Seamlessly generate and update your code with intelligent suggestions and recommendations using OpenAI. Identify and fix bugs in your code more efficiently with AI-powered debugging assistance. Get clear explanations and documentation for complex code snippets and algorithms. Craft compelling technical documentation, meeting notes, and blog posts with precision and clarity. DevPromptAi is free to use. You will need to have a working OpenAI API key in order to use the app. When you use the OpenAI API key, you pay directly to OpenAI for the amount of credits/tokens you use. Your API is safe and stored encrypted locally on your device in the browser's local storage. Requests to Open AI's API are sent directly from your browser window. DevPromptAi only stores your API key locally and never sends your API key anywhere.
    Starting Price: Free
  • 12
    UnoRouter

    UnoRouter

    UnoRouter

    UnoRouter is an OpenAI-compatible LLM gateway. One API key gives you 200+ models across providers (OpenAI, Anthropic, Google and more), drop-in for coding agents like Claude Code, Cline, Codex and Kilo Code. Point any OpenAI SDK at the base URL and switch models without changing code. UnoRouter also includes a built-in chat and character client (personas, lorebooks, SillyTavern card import) on the same key. Usage-based pricing with a free tier, live model and price data.
    Starting Price: Free tier, usage-based
  • 13
    ChainForge

    ChainForge

    ChainForge

    ChainForge is an open-source visual programming environment designed for prompt engineering and large language model evaluation. It enables users to assess the robustness of prompts and text-generation models beyond anecdotal evidence. Simultaneously test prompt ideas and variations across multiple LLMs to identify the most effective combinations. Evaluate response quality across different prompts, models, and settings to select the optimal configuration for specific use cases. Set up evaluation metrics and visualize results across prompts, parameters, models, and settings, facilitating data-driven decision-making. Manage multiple conversations simultaneously, template follow-up messages, and inspect outputs at each turn to refine interactions. ChainForge supports various model providers, including OpenAI, HuggingFace, Anthropic, Google PaLM2, Azure OpenAI endpoints, and locally hosted models like Alpaca and Llama. Users can adjust model settings and utilize visualization nodes.
  • 14
    RocketWhisper

    RocketWhisper

    Mojosoft Co., Ltd.

    RocketWhisper is a powerful desktop speech recognition and transcription application that runs 100% offline on your computer. Your voice data never leaves your machine - complete privacy guaranteed. Powered by OpenAI's Whisper engine with NVIDIA GPU (CUDA) acceleration, RocketWhisper delivers fast and accurate speech-to-text conversion for professionals, content creators, and anyone who works with voice and text. Key Features: - 100% offline processing - voice data never leaves your PC - OpenAI Whisper engine for high-accuracy speech recognition - NVIDIA CUDA GPU acceleration - up to 10x faster than CPU - Real-time voice-to-text input with global hotkey (Push-to-Talk with Right Alt) - Batch transcription of multiple audio/video files (MP3, WAV, M4A, MP4, MKV, AVI, etc.) - SRT/VTT subtitle export for video content - AI text formatting with LLM integration (OpenAI, Anthropic, Google Gemini, Grok, local LLM)
    Starting Price: $32 one-time
  • 15
    Voxtral

    Voxtral

    Mistral AI

    Voxtral models are frontier open source speech‑understanding systems available in two sizes—a 24 B variant for production‑scale applications and a 3 B variant for local and edge deployments, both released under the Apache 2.0 license. They combine high‑accuracy transcription with native semantic understanding, supporting long‑form context (up to 32 K tokens), built‑in Q&A and structured summarization, automatic language detection across major languages, and direct function‑calling to trigger backend workflows from voice. Retaining the text capabilities of their Mistral Small 3.1 backbone, Voxtral handles audio up to 30 minutes for transcription or 40 minutes for understanding and outperforms leading open source and proprietary models on benchmarks such as LibriSpeech, Mozilla Common Voice, and FLEURS. Accessible via download on Hugging Face, API endpoint, or private on‑premises deployment, Voxtral also offers domain‑specific fine‑tuning and advanced enterprise features.
  • 16
    Silkwave Voice
    Silkwave Voice is a privacy-focused audio recording and transcription app for macOS. Record from your microphone, system audio, or both at once - with accurate, real-time transcription powered by Apple's on-device speech-to-text models. No cloud uploads, no subscriptions, no per-minute API costs. RECORD ANY AUDIO SOURCE • Microphone - voice notes, in-person meetings, dictation • System Audio - Zoom, Google Meet, Teams, YouTube, browser tabs • Both at once - capture your mic and remote participants simultaneously ON-DEVICE TRANSCRIPTION • Real-time speech-to-text using Apple's on-device models • 10 languages: Cantonese, Chinese, English, French, German, Italian, Japanese, Korean, Portuguese, Spanish • Completely local - no internet connection needed AI-POWERED SUMMARIES • Structured summaries with key topics, action items, and decisions • Powered by ChatGPT through Apple Intelligence - no API keys needed
    Starting Price: $14 one-time
  • 17
    FLUX.1

    FLUX.1

    Black Forest Labs

    FLUX.1 is a groundbreaking suite of open-source text-to-image models developed by Black Forest Labs, setting new benchmarks in AI-generated imagery with its 12 billion parameters. It surpasses established models like Midjourney V6, DALL-E 3, and Stable Diffusion 3 Ultra by offering superior image quality, detail, prompt fidelity, and versatility across various styles and scenes. FLUX.1 comes in three variants: Pro for top-tier commercial use, Dev for non-commercial research with efficiency akin to Pro, and Schnell for rapid personal and local development projects under an Apache 2.0 license. Its innovative use of flow matching and rotary positional embeddings allows for efficient and high-quality image synthesis, making FLUX.1 a significant advancement in the domain of AI-driven visual creativity.
    Starting Price: Free
  • 18
    Sanctum

    Sanctum

    Sanctum

    Sanctum is a private, local AI assistant that lets users run and interact with full-featured open source LLMs locally on their own device. It is built as a private Sanctum for AI, where data is encrypted, secure, and never leaves the user’s computer. It makes it easy to run AI locally, with an easy-to-download desktop solution that lets users run large language models on a Mac instantly without complicated installs, and after downloading, no internet connection is required. Sanctum is designed around privacy-first local processing: with on-device encryption and processing, users maintain complete privacy and control. Its Hugging Face integration gives access to thousands of GGUF models directly through Sanctum, making it possible to check compatibility, download models, and start using them on a PC or Mac. Sanctum also supports private PDF workflows, allowing users to chat with PDFs, ask questions, and summarize files in a secure environment.
  • 19
    Nanobrowser

    Nanobrowser

    Nanobrowser

    Nanobrowser is an open-source, AI-powered web automation tool that runs directly in your browser, providing an alternative to costly services like OpenAI Operator. It features a multi-agent system, where specialized AI agents work together to handle complex web workflows efficiently. Nanobrowser offers flexible LLM (Large Language Model) options, enabling users to connect to various providers like OpenAI, Anthropic, and Gemini. The platform is privacy-focused, with everything running locally in the browser to ensure user credentials remain secure. As a free tool, it provides powerful web automation capabilities without the high subscription fees.
    Starting Price: Free
  • 20
    GLM-Image
    GLM-Image is a next-generation, open source image generation model developed by Z.ai, designed to combine deep language understanding with high-fidelity visual synthesis. Unlike traditional diffusion-only models, it uses a hybrid architecture that integrates an autoregressive language model with a diffusion decoder, enabling it to first reason about the structure, meaning, and relationships within a prompt before generating the image itself. This approach allows GLM-Image to excel in scenarios that require precise semantic control, such as generating infographics, presentation slides, posters, and diagrams with accurate embedded text and complex layouts. With a total of around 16 billion parameters, the model achieves strong performance in rendering readable, correctly placed text within images, an area where many image models struggle, while maintaining detailed visual quality and consistency.
  • 21
    Flow-Like

    Flow-Like

    TM9657 GmbH

    Flow-Like is an open-source, typed, local-first workflow automation engine for building and executing automation and AI workflows in self-hosted or offline environments. It combines visual, graph-based workflows with strong typing and deterministic execution, making complex systems easier to understand, validate, and maintain. Unlike many workflow tools that rely on untyped JSON, cloud-only backends, or opaque runtime behavior, Flow-Like makes data flow and execution explicit and inspectable. Workflows can run locally, on private servers, in containers, or in Kubernetes without changing semantics. The core runtime is written in Rust for performance, safety, and portability. Flow-Like supports event-driven automation, data processing, document ingestion, and AI pipelines, including typed agent and RAG workflows using local or hosted models. It is designed for developers and organizations that need reliable automation with full control over infrastructure and data.
    Starting Price: $9.99/month
  • 22
    Hyprnote

    Hyprnote

    Hyprnote

    Hyprnote is an open source, local-first AI-powered notepad tailored for professionals with back-to-back meetings. It transcribes and summarizes conversations directly on your device, without sending any data to the cloud. Using open source models like Whisper and HyprLLM, it listens to both your microphone and system audio during meetings and provides real-time transcripts along with polished summaries that intelligently blend your rough notes with context from the discussion. With customizable templates and autonomy settings, you decide how much the AI reshapes your input, from staying close to your notes to creating more refined narratives. It features built-in AI chat, allowing queries like "What were the action items?" or "Translate this to Spanish," supports extensions and workflow automations, and integrates with tools like Obsidian, Apple Calendar, and more, with enterprise-ready self-hosting options.
    Starting Price: $8 per month
  • 23
    LFM2.5

    LFM2.5

    Liquid AI

    Liquid AI’s LFM2.5 is the next generation of on-device AI foundation models designed to deliver high-performance, efficient AI inference on edge devices such as phones, laptops, vehicles, IoT systems, and embedded hardware without relying on cloud compute. It extends the previous LFM2 architecture by significantly increasing the pretraining scale and reinforcement learning stages, yielding a family of hybrid models around 1.2 billion parameters that balance instruction following, reasoning, and multimodal capabilities for real-world agentic use cases. The LFM2.5 family includes Base (for fine-tuning and customization), Instruct (general-purpose instruction-tuned), Japanese-optimized, Vision-Language, and Audio-Language variants, all optimized for fast, on-device inference under tight memory constraints and available as open-weight models deployable via frameworks like llama.cpp, MLX, vLLM, and ONNX.
    Starting Price: Free
  • 24
    Odysseus

    Odysseus

    PewDiePie

    Odysseus is an open-source, self-hosted AI workspace that allows users to interact with language models directly on their own hardware. The platform combines AI chat, autonomous agents, research tools, model management, email assistance, and persistent memory into a single local-first environment. Users can connect their preferred language models and endpoints while maintaining complete control over their data and infrastructure. Built-in capabilities include tool integration, model comparison, deep research workflows, and support for MCP servers. Odysseus is designed with privacy in mind, operating without telemetry and keeping sensitive information within the user’s environment. By providing a unified workspace for AI-powered tasks, Odysseus helps users leverage advanced AI functionality without relying on third-party cloud platforms.
  • 25
    Vision Agents
    Vision Agents is an open source Python framework for building low-latency voice and video AI agents with any model. It lets developers plug in LLM, speech, and vision models from more than 25 providers and ship real-time agents for telehealth, voice support, live coaching, video analysis, interactive avatars, security monitoring, sports commentary, and other multimodal applications. It is designed to help teams build agents that can listen, speak, see, process media, call tools, and respond in real time while running on Stream’s global edge network with sub-500ms latency. Developers can build a first agent in minutes, using a small Python setup with Gemini Realtime, OpenAI, Deepgram, ElevenLabs, Stream, or other supported providers. Vision Agents supports both real-time speech-to-speech models and custom STT/LLM/TTS pipelines, giving teams either the fastest path to a working voice agent or full control over speech recognition, language reasoning, text-to-speech, etc.
    Starting Price: Free
  • 26
    Codey

    Codey

    Codey Labs

    Codey is a local AI workspace that enables developers to build applications, run AI agents, automate workflows, and access more than 70 AI providers from a single desktop environment. The platform runs locally, allowing users to work with their own projects while maintaining control over their code, files, and AI integrations. Codey includes specialized AI agents for software development, planning, code exploration, research, and productivity tasks that collaborate to complete complex workflows. It also features Autopilot for end-to-end application generation and Workpilot for document creation, web browsing, file management, and workflow automation. Users can connect existing accounts for providers such as Claude, OpenAI, Gemini, OpenRouter, and local language models without paying additional model usage fees to Codey. Codey helps developers combine AI coding, automation, and productivity tools into one private, locally controlled workspace.
    Starting Price: $10/month
  • 27
    NativeMind

    NativeMind

    NativeMind

    NativeMind is an open source, on-device AI assistant that runs entirely in your browser via Ollama integration, ensuring absolute privacy by never sending data to the cloud. Everything, from model inference to prompt processing, occurs locally, so there’s no syncing, logging, or data leakage. Users can load and switch between powerful open models such as DeepSeek, Qwen, Llama, Gemma, and Mistral instantly, without additional setup, and leverage native browser features for streamlined workflows. NativeMind offers clean, concise webpage summarization; persistent, context-aware chat across multiple tabs; local web search that retrieves and answers queries directly within the page; and immersive, format-preserving translation of entire pages. Built for speed and security, the extension is fully auditable and community-backed, delivering enterprise-grade performance for real-world use cases without vendor lock-in or hidden telemetry.
    Starting Price: Free
  • 28
    whatwide.ai

    whatwide.ai

    WhatWide Labs

    Introducing whatwide.ai, the ultimate AI assistant that leverages OpenAI, AWS Polly, and ClipDrop API to: Create and enhance content swiftly using cutting-edge AI models like DALL-E v2, DALL-E v3, and StableDiffusion with minimal text input. Upscale images for improved resolution and visual appeal. Transcribe speech to text and generate audio from written content. Personalize AI chat interactions with unlimited AI personalities for direct and engaging responses. Generate AI code through chat or document functionalities. Access 50 customizable AI text templates and choose preferred OpenAI models such as GPT-4 or GPT-3.5 Turbo.
  • 29
    SillyTavern

    SillyTavern

    SillyTavern

    SillyTavern is a free, open-source AI chat platform that allows users to create and interact with AI-generated characters, making it ideal for role-playing, storytelling, and fan fiction. As a locally installed user interface, it connects to various large language models like OpenAI, KoboldAI, and Claude, providing a customizable and immersive experience. Users can engage in individual or group chats, craft prompts to steer conversations, and utilize features like chat bookmarks and a customizable user interface. SillyTavern supports extensions and is compatible many devices. While the software is free, users need to connect it to an AI model backend, which may involve additional costs depending on the chosen model. Add bookmarks to any point in a chat to easily hop back in for reading or to start the chat back up in a new direction.
    Starting Price: Free
  • 30
    Jan

    Jan

    Jan.ai

    Jan is an open-source personal AI assistant designed to run locally on your device, giving you full control over your data and privacy. It allows users to interact with AI models without relying on cloud-based services or incurring API costs. The platform supports a wide range of models, including popular options from OpenAI, Anthropic, Google, Meta, and others. Jan provides a clean, user-friendly interface that makes it easy to chat, research, and complete tasks efficiently. It also includes real-time web search capabilities to enhance responses with up-to-date information. Users can customize their experience by selecting different models and integrating external providers. Jan is lightweight and optimized for performance, enabling smooth operation even on personal machines. It empowers users to build a private, flexible AI environment tailored to their needs.
    Starting Price: Free
  • 31
    MacWhisper

    MacWhisper

    Gumroad

    ​MacWhisper enables users to quickly and easily transcribe audio files into text using OpenAI's Whisper technology. Users can record directly from their microphone or any input device on their Mac, or drag and drop audio files for high-quality transcription. It supports recording meetings from platforms like Zoom, Teams, Webex, Skype, Chime, and Discord, with all transcription processing done locally to ensure data privacy. Transcripts can be saved or exported in various formats, including .srt, .vtt, .csv, .docx, .pdf, markdown, and HTML. MacWhisper offers fast transcription speeds, supports over 100 languages, and provides features like search, audio playback synced to transcripts, filler word removal, and speaker addition. The Pro version includes additional functionalities such as batch transcription, YouTube video transcription, AI service integrations (e.g., OpenAI's ChatGPT, Anthropic's Claude), system-wide dictation, and translation of audio files into other languages.
    Starting Price: €59 one-time payment
  • 32
    Gemma 3n

    Gemma 3n

    Google DeepMind

    Gemma 3n is our state-of-the-art open multimodal model, engineered for on-device performance and efficiency. Made for responsive, low-footprint local inference, Gemma 3n empowers a new wave of intelligent, on-the-go applications. It analyzes and responds to combined images and text, with video and audio coming soon. Build intelligent, interactive features that put user privacy first and work reliably offline. Mobile-first architecture, with a significantly reduced memory footprint. Co-designed by Google's mobile hardware teams and industry leaders. 4B active memory footprint with the ability to create submodels for quality-latency tradeoffs. Gemma 3n is our first open model built on this groundbreaking, shared architecture, allowing developers to begin experimenting with this technology today in an early preview.
  • 33
    Private LLM

    Private LLM

    Private LLM

    Private LLM is a local AI chatbot for iOS and macOS that works offline, keeping your information completely on-device, safe, and private. It doesn't need the internet to work, so your data never leaves your device. It stays just with you. With no subscription fees, you pay once and use it on all your Apple devices. It's designed for everyone, with easy-to-use features for generating text, helping with language, and a whole lot more. Private LLM uses the latest AI models quantized with state-of-the-art quantization techniques to provide a high-quality on-device AI experience without compromising your privacy. It's a smart, secure way to get creative and productive, anytime and anywhere. Private LLM opens the door to the vast possibilities of AI with support for an extensive selection of open-source LLM models, including the Llama 3, Google Gemma, Microsoft Phi-2, Mixtral 8x7B family and many more on both your iPhones, iPads and Macs.
  • 34
    Spanlens

    Spanlens

    Spanlens

    Spanlens is an open-source (MIT) LLM observability platform that lets developers monitor every call their application makes to OpenAI, Anthropic, Gemini, Mistral, OpenRouter, Azure OpenAI, or a local Ollama model. Integration takes one line: swap your client's baseURL to the Spanlens proxy, or run "npx @spanlens/cli init" and the wizard rewrites your code automatically. From that moment, every request is recorded with its model, token counts, latency, cost, and full prompt and response body, with streaming responses reconstructed automatically. The dashboard turns that raw log into operational insight. Cost tracking breaks spend down per request, per model, and per end user, and parses prompt-cache tokens separately so you see real cache savings rather than sticker price. Agent tracing visualizes multi-step workflows as Gantt waterfalls and node-and-edge graphs, highlighting the critical path so you can find the slowest dependency chain in a fan-out.
  • 35
    OpenWork

    OpenWork

    OpenWork

    OpenWork is an open source, AI-powered desktop application designed to help individuals and teams run, manage, and share agentic workflows using large language models through a unified, local-first environment. It allows users to connect to more than 50 LLM providers, bring their own API keys, and integrate existing tools, skills, and plugins into a single workspace, enabling flexible and customizable AI-driven automation. It transforms plain-language instructions into executable actions, such as automating browser tasks, extracting data, or generating outputs across connected applications, while providing a transparent execution timeline that shows what actions were taken and why. OpenWork emphasizes composability and extensibility, supporting desktop, CLI, and cloud configurations, and enabling workflows to be packaged as reusable “skills” that can be shared with teams through a single link and imported instantly without technical setup.
    Starting Price: $50 per month
  • 36
    Oxlo.ai

    Oxlo.ai

    Oxlo.ai

    Oxlo.ai is a privacy-first inference stack for agents, built to run frontier-class open-source models with unlimited agentic tool calls, secure failover, and zero data retention or training. It gives developers request-based access to curated open models through a unified HTTP API designed for predictable usage, low-latency inference, and clean integration into production systems. Teams can call models through OpenAI-compatible endpoints, switch from another provider by changing the base URL and API key, and keep support for streaming, function calling, JSON mode, vision models, embeddings, and image generation. Oxlo.ai supports more than 40 models across text, chat, reasoning, coding, image generation, audio, embeddings, computer vision, vision-language, speech-to-text, text-to-speech, long-context, and detection workflows.
    Starting Price: $80 per month
  • 37
    Miso TTS

    Miso TTS

    Miso TTS

    Miso Labs builds emotive foundation models for voice, designed to help developers create voice agents that feel fast, warm, and human instead of robotic or delayed. Its flagship model, Miso TTS, is an 8-billion-parameter transformer model for state-of-the-art emotive speech and dialogue generation, with open source weights available on Hugging Face and API access coming soon. Miso is built for real-time conversational voice, responding in 110ms to preserve natural flow and avoid the awkward pauses common in AI voice agents. It supports one-shot voice cloning, allowing users to clone a voice from a ten-second audio clip while keeping the agent’s voice consistent from the first second of a call to the last. Miso Labs also emphasizes local and sovereign deployment, with open source models built for local use and on-premises hosting and support available for enterprise teams that need to keep sensitive data in-house.
  • 38
    Kolosal AI

    Kolosal AI

    Kolosal AI

    Kolosal AI is a cutting-edge platform that enables users to run local large language models (LLMs) directly on their devices, ensuring full privacy and control without the need for cloud-based dependencies. This lightweight, open-source application allows for seamless chat and interaction with local LLMs, providing powerful AI capabilities on personal hardware. Kolosal AI emphasizes speed, customization, and security, making it ideal for users who need a private, offline solution to work with LLMs without any subscriptions or external services.
  • 39
    DoCoreAI

    DoCoreAI

    MobiLights

    DoCoreAI is an AI prompt optimization and telemetry platform designed for AI-first product teams, SaaS companies, and developers working with large language models (LLMs) like OpenAI & Groq (Infra). With a local-first Python client and secure telemetry engine, DoCoreAI enables teams to collect LLM usage metrics without exposing original prompts & ensuring data privacy. Key Capabilities: - Prompt Optimization → Improve efficiency and reliability of LLM prompts. - LLM Usage Monitoring → Track tokens, response times, and performance trends. - Cost Analytics → Monitor and optimize LLM costs across teams. - Developer Productivity Dashboards → Identify time savings and usage bottlenecks. - AI Telemetry → Collect detailed insights while maintaining user privacy. DoCoreAI helps businesses save on token costs, improve AI model performance, and give developers a single place to understand how prompts behave in production.
    Starting Price: $9/month
  • 40
    Parity Layer

    Parity Layer

    Parity Layer

    Parity Layer is a drop-in layer for the OpenAI, Anthropic, and Google SDKs. It optimises a cheaper model to match or beat your current one on your own production prompts, proves it before switching anything, and instantly falls back to your baseline if quality ever drifts. Teams cut AI API spend 30-60% with no quality loss. First proof in a day, up to 10 prompts free, no credit card. Not built for coding agents.
  • 41
    GPT4All

    GPT4All

    Nomic AI

    GPT4All is an ecosystem to train and deploy powerful and customized large language models that run locally on consumer-grade CPUs. The goal is simple - be the best instruction-tuned assistant-style language model that any person or enterprise can freely use, distribute and build on. A GPT4All model is a 3GB - 8GB file that you can download and plug into the GPT4All open-source ecosystem software. Nomic AI supports and maintains this software ecosystem to enforce quality and security alongside spearheading the effort to allow any person or enterprise to easily train and deploy their own on-edge large language models. Data is one the most important ingredients to successfully building a powerful, general-purpose large language model. The GPT4All community has built the GPT4All open source data lake as a staging ground for contributing instruction and assistant tuning data for future GPT4All model trains.
    Starting Price: Free
  • 42
    LocalChat.app

    LocalChat.app

    LocalChat.app

    LocalChat is a local-first desktop AI application for macOS that lets you chat with over 300 open-source AI models - completely offline, with zero data collection, and no account required. Built natively for Apple Silicon (M1-M6), LocalChat delivers fast, private AI conversations without ever sending a single byte of data to the cloud. Pay once, own it forever - no subscriptions, no recurring fees. Key Features - Chat with Documents: Attach PDF, XLS, PPT, DOC, etc and ask AI to summarize - Retrieval Augmented Generation (RAG) Support: Index multiple documents and ask questions Benefits - No Subscriptions: One-time payment of just 49$ - End-to-End Privacy: Zero cloud servers. Zero data collection. Zero tracking. Conversations are processed and stored locally on your Mac. - New Models Added every month: We keep up with latest AI models so you don't have to, we suggest what model to use for which tasks
    Starting Price: $50 Lifetime
  • 43
    Neuron AI

    Neuron AI

    Neuron AI

    ​Neuron AI is an AI chat and productivity tool optimized for Apple Silicon, offering on-device processing for enhanced speed and privacy. It allows users to engage in AI conversations and summarize audio recordings without requiring an internet connection, ensuring that data remains on the device. It supports unlimited AI chats and provides access to over 45 advanced AI models from providers like OpenAI, DeepSeek, Meta, Mistral, and Huggingface. Users can customize system prompts, manage transcripts, and personalize the interface with options such as dark mode, accent colors, fonts, and haptic feedback. Neuron AI is compatible across iPhone, iPad, Mac, and Vision Pro devices, enabling seamless integration into various workflows. It also offers integration with the Shortcuts app for extensive automation capabilities and allows easy sharing of messages, summaries, or audio recordings via email, text, AirDrop, notes, or other third-party applications.
  • 44
    TypingMind

    TypingMind

    TypingMind

    TypingMind is free to use with some basic features. You will need to have a working OpenAI API Key in order to use the app. When you use the API Key, you pay directly to OpenAI for the number of credits/tokens you use. TypingMind.com has premium features that can be unlocked with a one-time purchase. This is a static web app, it doesn't have any backend server. When you enter your API key, it will be stored locally and securely on your browser. All API requests are sent directly from your browser to OpenAI server to interact with ChatGPT. Think of this as an HTTP client for your ChatGPT API with a lot of convenience features. You can have as many chats as you want. The only limit is your OpenAI API key's limit and your browser storage limit (technical term: Local Storage). Web browser gives you some limited data storage, the actual limit is different for each browser. Typically, you can save thousands of chat conversations without problems, but that's not guaranteed.
    Starting Price: $20 per month
  • 45
    Aion 1.0 Plan

    Aion 1.0 Plan

    Microsoft

    Aion 1.0 Plan is Microsoft’s local agentic reasoning model for Windows, designed to bring fully agentic workflows onto the device without cloud dependency or per-token cost. It is a 14-billion-parameter reasoning and tool-calling model with a 32K context length, shipping in-box as part of Windows on capable devices. Unlike smaller on-device models focused on everyday text intelligence, Aion 1.0 Plan is built for local agentic reasoning, enabling applications to understand user intent, invoke tools, manage files, and orchestrate sub-agents directly on the device. It belongs to Microsoft’s new generation of on-device small language models purpose-built for local execution, representing the progression from efficient text intelligence at scale to more capable local planning and action. Aion 1.0 Plan is part of Windows’ broader push toward “unmetered intelligence,” where frontier models handle the hardest problems while local models support continuous, lower-cost agent workflows.
  • 46
    AI Chat Bestie

    AI Chat Bestie

    AI Chat Bestie

    Connect directly to the OpenAI API and bypass slow typing animations for quick response times. Leave your tab open and stay connected forever without having to log back in. Dig up old conversations and find lost answers. All keys and chats are stored locally within your browser, accessible at any time. Storing keys, chats, and sending messages are done directly in the browser with no intermediaries. Get your own OpenAI API key for free.
  • 47
    Qwen-Image

    Qwen-Image

    Alibaba

    Qwen-Image is a multimodal diffusion transformer (MMDiT) foundation model offering state-of-the-art image generation, text rendering, editing, and understanding. It excels at complex text integration, seamlessly embedding alphabetic and logographic scripts into visuals with typographic fidelity, and supports diverse artistic styles from photorealism to impressionism, anime, and minimalist design. Beyond creation, it enables advanced image editing operations such as style transfer, object insertion or removal, detail enhancement, in-image text editing, and human pose manipulation through intuitive prompts. Its built-in vision understanding tasks, including object detection, semantic segmentation, depth and edge estimation, novel view synthesis, and super-resolution, extend its capabilities into intelligent visual comprehension. Qwen-Image is accessible via popular libraries like Hugging Face Diffusers and integrates prompt-enhancement tools for multilingual support.
    Starting Price: Free
  • 48
    Prompt Selected

    Prompt Selected

    Prompt Selected

    Prompt Selected is an AI-powered browser extension that allows users to run custom ChatGPT prompts on any selected text, requiring their own OpenAI API key for functionality (BYOK). With unlimited prompts, prebuilt examples, and GPT model support, it simplifies grammar corrections, translations, and text summaries. The tool ensures data security with local key storage and zero tracking. Take control of your AI needs with one powerful, customizable extension.
    Starting Price: Free
  • 49
    Kimchi

    Kimchi

    Kimchi

    Kimchi is a centralized gateway for managing SaaS and self-hosted AI models, built to help teams deploy, route, optimize, and scale LLM infrastructure without changing the developer workflow. It gives organizations one control layer for AI coding agents, open-source models, commercial models, and internal inference, allowing teams to combine lower-cost OSS models with higher-tier providers such as Claude, OpenAI, Gemini, and others when the task requires it. Kimchi focuses on reducing LLM cost while making development more autonomous, with fast model routing, coding-oriented inference, MCP integration, multi-agent workflows, interchangeable OSS and commercial models, and low-friction local setup. It supports running the Kimchi coding agent across teams, giving engineering organizations broader access to AI coding while preserving team-wide usage attribution, cost visibility, and operational control.
    Starting Price: Free
  • 50
    Bruno

    Bruno

    Bruno Software Inc.

    Bruno is an open-source, local-first API client for exploring, testing, and documenting APIs. With native Git sync, offline data storage, and no cloud dependencies, Bruno offers developers a secure, fast, and open alternative to bloated API platforms. Trusted by 150 k+ daily users and loved by 37 k+ GitHub stargazers. Pure API Client — Bruno is not a platform or cloud SaaS. It’s a lightweight desktop app focused purely on exploring, testing, and documenting APIs — no unnecessary clutter. Local-First Security — All your data and collections stay on your machine. Nothing is synced to a third-party cloud, ensuring complete control and compliance. Native Git Sync — Collaborate and version your collections using the same workflows you already use for code — pull requests, branches, and diffs — with no proprietary lock-in. Open Source & Extensible — Backed by a passionate community, Bruno evolves transparently, with frequent contributions from developers across the world
    Starting Price: $6 per user per month