Alternatives to Private LLM
Compare Private LLM alternatives for your business or organization using the curated list below. SourceForge ranks the best alternatives to Private LLM in 2026. Compare features, ratings, user reviews, pricing, and more from Private LLM competitors and alternatives in order to make an informed decision for your business.
-
1
Enterprise Bot
Enterprise Bot
Enterprise Bot, based in Switzerland, is a pioneer in Conversational AI, Process Automation, and Generative AI. With the trust of esteemed enterprise giants across industries like Generali, SIX, SBB, DHL, and SWICA, Enterprise Bot is revolutionizing both customer and employee experiences. Through its advanced integration with Large Language Models (LLM) such as ChatGPT and Llama 2, and its unique patent-pending DocBrain technology, the company delivers unparalleled personalization, active engagement, and omnichannel solutions across platforms like email, voice, and chat. Furthermore, Enterprise Bot integrates with existing core systems, such as SAP, CRMs, Confluence and more, and with its proprietary middleware, Blitzico, enables the AI to not only respond to queries but also take action to resolve them. This dedication to innovation in four main use case areas, Customer Support, Sales and Marketing, Knowledge Management and Digital Coworker, elevates both CX and employee productivity. -
2
Zoho SalesIQ
Zoho
Zoho SalesIQ is a comprehensive live chat and chatbot platform that provides businesses with website visitor tracking, lead generation, and visitor analytics. These features are all integrated into a single platform, making it a one-stop-shop for businesses looking to improve their customer engagement and overall customer experience. It comes equipped with a patented ring view for visitor identification in real time, lead scoring, built-in audio calling, screen sharing, profanity management, and different types of bots based on your business requirement. From a codeless bot builder to an advanced AI chatbot that can be integrated with OpenAI or Zia, Zoho's in-house LLM, SalesIQ has it all. The platform also includes instant messaging channels that integrate with Instagram, Telegram, WeChat, Line and more so businesses can reach prospects and customers on platforms they already use. SalesIQ is optimized to suit the customer communication needs of both B2B and B2C businesses ofStarting Price: $0/month -
3
Social Intents
Social Intents
Social Intents brings AI-powered live chat and chatbot automation directly into the collaboration tools your business already uses—Microsoft Teams, Slack, Google Chat, Zoom, and Webex—so your team can engage website visitors without switching platforms. Easily launch advanced ChatGPT, Gemini, and Claude AI chatbots with one click—no coding required. Automate up to 75% of your customer conversations by training your AI assistant on your website content, help docs, and knowledge base. Deliver fast, intelligent answers to common questions and boost your conversion rates with 24/7 automated support. When customers need a human touch, seamlessly escalate chats to your support or sales team inside your existing collaboration environment. Provide real-time live chat, sales assistance, and after-hours customer support—all from tools like Microsoft Teams, Slack, and Google Chat. Whether you're improving customer satisfaction, or capturing more leads, Social Intents can help.Starting Price: $39 per month -
4
Ochatbot
Ometrics
Ochatbot’s leading AI chatbot features are designed for ecommerce platforms for Shopify chatbots, BigCommerce chatbots, WooCommerce chatbots and Magento chatbots as well as B2B sales and support chatbot. Lift revenues from 20% to 40% when the shopper engages with Ochatbot and reduce support tickets from 25% to 45%. No code, auto install AI platform. Our Pro and Enterprise plans include an eCommerce Guarantee. Ochatbot engages customers overcoming sales obstacles, providing product recommendations, upselling and cross-selling, abandoned cart, and answering support questions including order tracking. The AI chatbot communicates through NLP textual conversations becoming smarter over time about your products and services. The AI chatbot determines the customers AI Happiness Sentiment, Customer Reaction data along with marketing and sales insights. Ochatbot also comes with 9 conversion optimization tools such as 80+ Leadbots, Offer Sliders, Popups, live chat and more.Starting Price: Free -
5
EmbeddingGemma
Google
EmbeddingGemma is a 308-million-parameter multilingual text embedding model, lightweight yet powerful, optimized to run entirely on everyday devices such as phones, laptops, and tablets, enabling fast, offline embedding generation that protects user privacy. Built on the Gemma 3 architecture, it supports over 100 languages, processes up to 2,000 input tokens, and leverages Matryoshka Representation Learning (MRL) to offer flexible embedding dimensions (768, 512, 256, or 128) for tailored speed, storage, and precision. Its GPU-and EdgeTPU-accelerated inference delivers embeddings in milliseconds, under 15 ms for 256 tokens on EdgeTPU, while quantization-aware training keeps memory usage under 200 MB without compromising quality. This makes it ideal for real-time, on-device tasks such as semantic search, retrieval-augmented generation (RAG), classification, clustering, and similarity detection, whether for personal file search, mobile chatbots, or custom domain use. -
6
Locally AI
Locally AI
Locally AI is an on-device AI application that allows users to run powerful language models directly on their iPhone, iPad, or Mac without relying on cloud infrastructure or an internet connection. Built on Apple’s MLX framework, it delivers fast, efficient performance while minimizing power usage, enabling a seamless experience for chatting, creating, learning, and exploring AI capabilities across devices. It supports multiple open models such as Llama, Gemma, Qwen, and DeepSeek, allowing users to switch between them and tailor outputs to different tasks. Everything runs entirely offline, meaning no login is required, and no data is collected or transmitted, ensuring complete privacy and control over personal information. Users can interact with AI through natural conversations, analyze documents or images, and generate text in a unified interface designed for simplicity and responsiveness.Starting Price: Free -
7
Mirai
Mirai
Mirai is a developer-focused on-device AI infrastructure platform designed to convert, optimize, and run machine learning models directly on Apple devices with high performance and privacy. It provides a unified pipeline that enables teams to convert and quantize models, benchmark them, distribute them, and execute inference locally. It is built specifically for Apple Silicon and aims to deliver near-zero latency, zero inference cost, and full data privacy by keeping sensitive processing on the user’s device. Through its SDK and inference engine, developers can integrate AI features into applications quickly, using hardware-aware optimizations that unlock the full power of the GPU and Neural Engine. Mirai also includes dynamic routing capabilities that automatically decide whether a request should run locally or in the cloud based on latency, privacy, or workload requirements. -
8
Ai2 OLMoE
The Allen Institute for Artificial Intelligence
Ai2 OLMoE is a fully open source mixture-of-experts language model that is capable of running completely on-device, allowing you to try our model privately and securely. Our app is intended to help researchers better explore how to make on-device intelligence better and to enable developers to quickly prototype new AI experiences, all with no cloud connectivity required. OLMoE is a highly efficient mixture-of-experts version of the Ai2 OLMo family of models. Experience which real-world tasks state-of-the-art local models are capable of. Research how to improve small AI models. Test your own models locally using our open-source codebase. Integrate OLMoE into other iOS applications. The Ai2 OLMoE app provides privacy and security by operating completely on-device. Easily share the output of your conversations with friends or colleagues. The OLMoE model and the application code are fully open source.Starting Price: Free -
9
Siri
Apple
Apple Intelligence and Siri AI bring a more personal, powerful AI experience to Apple devices by helping users communicate, create, search, and get things done across apps. Siri AI is designed to understand personal context, answer open-ended questions, take actions in apps, and support natural conversations. Visual Intelligence lets users ask questions about what is on screen, in front of the camera, or visible through Apple Vision Pro. Apple Intelligence also adds smarter photo editing, image generation, writing assistance, translation, dictation, Safari organization, password updates, and shortcut creation. Privacy is central to the system, using on-device processing and Private Cloud Compute to protect user data. By integrating AI directly into iPhone, iPad, Mac, Apple Watch, Apple Vision Pro, and supported apps, Apple Intelligence helps users work faster while keeping their information private. -
10
InsertChat
InsertChat
We create the best AI chatbots, with no coding needed. Our top AI models and pre-built agents use your data to deliver accurate answers for any industry, ensuring excellent performance and satisfaction. Quickly set up your AI chatbot on any webpage to support visitors with a simple piece of JavaScript code. Just create your account, get your unique code, add it to your webpage, and your AI chatbot will be ready to help. AI chatbots are great at chatting with your customers first. But don't worry, if they need extra help, our chatbots will hand it over to a real person. This way, every customer feels cared for and gets the help they need. Continuously improves the chatbot’s performance by retraining its models based on new data, ensuring it stays up-to-date and accurate. Access and review all past interactions to better understand customer needs and improve service. Utilize state-of-the-art AI models to provide accurate and contextually relevant responses to user queries.Starting Price: $79 per month -
11
fullmoon
fullmoon
Fullmoon is a free, open source application that enables users to interact with large language models directly on their devices, ensuring privacy and offline accessibility. Optimized for Apple silicon, it operates seamlessly across iOS, iPadOS, macOS, and visionOS platforms. Users can personalize the app by adjusting themes, fonts, and system prompts, and it integrates with Apple's Shortcuts for enhanced functionality. Fullmoon supports models like Llama-3.2-1B-Instruct-4bit and Llama-3.2-3B-Instruct-4bit, facilitating efficient on-device AI interactions without the need for an internet connection.Starting Price: Free -
12
Vicuna
lmsys.org
Vicuna-13B is an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achieves more than 90%* quality of OpenAI ChatGPT and Google Bard while outperforming other models like LLaMA and Stanford Alpaca in more than 90%* of cases. The cost of training Vicuna-13B is around $300. The code and weights, along with an online demo, are publicly available for non-commercial use.Starting Price: Free -
13
Private Mind
Software Mansion
Private Mind is an on-device AI assistant that works entirely offline, giving users local AI with total privacy. It is built around the belief that AI should live on the user’s device, with conversations, files, prompts, and data staying local instead of being sent to the cloud. Users can chat with the assistant without Wi-Fi, sign-ups, tracking, or cloud dependency, making it useful for planning trips, translating text, brainstorming ideas, analyzing data, learning new things, or getting help when internet access is unavailable. Private Mind supports chat with files, allowing users to interact with their own documents through on-device AI and intelligent retrieval without sending private material outside the device. It also includes speech-to-text, so users can speak naturally and get instant local transcriptions using Whisper. It supports multiple open-source AI models.Starting Price: Free -
14
Gemma 3n
Google DeepMind
Gemma 3n is our state-of-the-art open multimodal model, engineered for on-device performance and efficiency. Made for responsive, low-footprint local inference, Gemma 3n empowers a new wave of intelligent, on-the-go applications. It analyzes and responds to combined images and text, with video and audio coming soon. Build intelligent, interactive features that put user privacy first and work reliably offline. Mobile-first architecture, with a significantly reduced memory footprint. Co-designed by Google's mobile hardware teams and industry leaders. 4B active memory footprint with the ability to create submodels for quality-latency tradeoffs. Gemma 3n is our first open model built on this groundbreaking, shared architecture, allowing developers to begin experimenting with this technology today in an early preview. -
15
Note67
Note67
Note67 is a privacy-centric meeting assistant designed for professionals who demand total control over their data. Unlike traditional transcription tools that rely on cloud processing, Note67 is an open-source, local-first application for macOS that captures audio, transcribes speech, and generates intelligent summaries entirely on your device. No audio or text ever leaves your machine, ensuring zero data leakage. Built with performance and security in mind, the application leverages the power of Rust and Tauri to deliver a lightweight, native experience. It integrates seamless local AI capabilities, utilizing Whisper for high-accuracy speech-to-text and Ollama for generating insightful meeting summaries using local Large Language Models (LLMs). Key Features: 100% Local Processing: Powered by on-device Whisper models, ensuring your audio and transcripts remain completely private. -
16
Poe
Quora
Poe is an all-in-one platform that brings together the best AI models from across the industry into a single, easy-to-use interface. Users can chat with leading models like GPT-5, Claude, Gemini, Grok, DeepSeek, Mistral, and many others, as well as millions of custom bots created by the community. The platform supports image, video, and audio generation, AI-powered web search, and the ability to run multiple bots at once for deeper insights. Poe also lets users build their own bots, create applications, and sync their chats seamlessly across all devices. With new models added regularly—often on the day they're released—Poe keeps users on the cutting edge of AI innovation. It offers a generous free tier, with affordable plans for heavier usage starting at $4.99 per month.Starting Price: Free -
17
HuggingChat
Hugging Face
Making the best open source AI chat models available to everyone. HuggingChat is an open source ChatGPT alternative.Starting Price: Free -
18
Reka Flash 3
Reka
Reka Flash 3 is a 21-billion-parameter multimodal AI model developed by Reka AI, designed to excel in general chat, coding, instruction following, and function calling. It processes and reasons with text, images, video, and audio inputs, offering a compact, general-purpose solution for various applications. Trained from scratch on diverse datasets, including publicly accessible and synthetic data, Reka Flash 3 underwent instruction tuning on curated, high-quality data to optimize performance. The final training stage involved reinforcement learning using REINFORCE Leave One-Out (RLOO) with both model-based and rule-based rewards, enhancing its reasoning capabilities. With a context length of 32,000 tokens, Reka Flash 3 performs competitively with proprietary models like OpenAI's o1-mini, making it suitable for low-latency or on-device deployments. The model's full precision requires 39GB (fp16), but it can be compressed to as small as 11GB using 4-bit quantization. -
19
LibreChat
LibreChat
LibreChat is a powerful open-source application that unifies all your AI conversations into a single, customizable interface. It is designed to work seamlessly with any AI provider, including OpenAI, Anthropic, AWS, and Azure, giving users full flexibility and control. LibreChat supports advanced agents capable of file handling, code interpretation, and API-driven actions. The platform includes a built-in code interpreter that can securely execute multiple programming languages with zero setup. Users can create and manage artifacts like React components, HTML, and Mermaid diagrams directly within chat. Multimodal capabilities allow users to analyze images and interact with files in conversations. Trusted by organizations worldwide, LibreChat delivers a sleek, extensible experience for modern AI workflows.Starting Price: Free -
20
Silkwave Voice
Silkwave
Silkwave Voice is a privacy-focused audio recording and transcription app for macOS. Record from your microphone, system audio, or both at once - with accurate, real-time transcription powered by Apple's on-device speech-to-text models. No cloud uploads, no subscriptions, no per-minute API costs. RECORD ANY AUDIO SOURCE • Microphone - voice notes, in-person meetings, dictation • System Audio - Zoom, Google Meet, Teams, YouTube, browser tabs • Both at once - capture your mic and remote participants simultaneously ON-DEVICE TRANSCRIPTION • Real-time speech-to-text using Apple's on-device models • 10 languages: Cantonese, Chinese, English, French, German, Italian, Japanese, Korean, Portuguese, Spanish • Completely local - no internet connection needed AI-POWERED SUMMARIES • Structured summaries with key topics, action items, and decisions • Powered by ChatGPT through Apple Intelligence - no API keys neededStarting Price: $14 one-time -
21
NativeMind
NativeMind
NativeMind is an open source, on-device AI assistant that runs entirely in your browser via Ollama integration, ensuring absolute privacy by never sending data to the cloud. Everything, from model inference to prompt processing, occurs locally, so there’s no syncing, logging, or data leakage. Users can load and switch between powerful open models such as DeepSeek, Qwen, Llama, Gemma, and Mistral instantly, without additional setup, and leverage native browser features for streamlined workflows. NativeMind offers clean, concise webpage summarization; persistent, context-aware chat across multiple tabs; local web search that retrieves and answers queries directly within the page; and immersive, format-preserving translation of entire pages. Built for speed and security, the extension is fully auditable and community-backed, delivering enterprise-grade performance for real-world use cases without vendor lock-in or hidden telemetry.Starting Price: Free -
22
Genie
Genie
Genie is a revolutionary AI chatbot powered by ChatGPT & GPT-4. From writing stories, poems, and tweets to answering any question you have, Genie can do it all. Genie AI is not just any chatbot app; it's a super helpful tool, crafted with advanced AI technology from GPT-4o. Imagine having a clever friend right on your phone, always ready to chat, assist, and simplify your daily routine. This chatbot is exceptional because it harnesses the intelligence of GPT-4, ensuring a deeper understanding of your needs and queries. Interacting with Genie, an AI chatbot, is both enjoyable and practical. You can throw any question at it, seek advice, organize your schedule, or indulge in a casual conversation. What makes it stand out is the incorporation of GPT-4's advanced AI capabilities, making it not just smart, but incredibly intuitive. Whether you're tech-savvy or just a regular smartphone user, you'll find Genie's interface user-friendly and easy to navigate.Starting Price: Free -
23
ChatGPT Pro
OpenAI
As AI becomes more advanced, it will solve increasingly complex and critical problems. It also takes significantly more compute to power these capabilities. ChatGPT Pro is a $200 monthly plan that enables scaled access to the best of OpenAI’s models and tools. This plan includes unlimited access to our smartest model, OpenAI o1, as well as to o1-mini, GPT-4o, and Advanced Voice. It also includes o1 pro mode, a version of o1 that uses more compute to think harder and provide even better answers to the hardest problems. In the future, we expect to add more powerful, compute-intensive productivity features to this plan. ChatGPT Pro provides access to a version of our most intelligent model that thinks longer for the most reliable responses. In evaluations from external expert testers, o1 pro mode produces more reliably accurate and comprehensive responses, especially in areas like data science, programming, and case law analysis.Starting Price: $200/month -
24
CHAI
CHAI
We're building the leading platform for chat AI. We started with a proprietary dataset of billions of chat messages, and we spent over $3 million to train uniquely engaging language models. Now millions of people routinely chat on our platform. We obsessively optimize our language models, continually making them more entertaining than ever before. Discover chat AIs from around the globe, and speak with them to discover their capabilities. Millions of people chatting, creating, and sharing chat AI personalities. We are empowering our community to create and experience the world's most entertaining chat AI. Our models are trained on billions of tokens and millions of reward signals generated by our users. By running AB tests with real users, our latest model surpasses OpenAI ChatGPT's performance measured by session screen time. We create and optimize our own language models, we are continually training our models on our proprietary chat message dataset.Starting Price: Free -
25
QuickWhisper
IWT Pty Ltd
QuickWhisper is a macOS application for transcription, dictation, and AI summarization using OpenAI's Whisper model. It runs entirely on-device with no cloud dependency required. The application transcribes audio from local files, YouTube videos, online meetings, and system audio. QuickWhisper can record meetings with calendar integration while keeping the recording interface hidden during screen sharing. System-wide dictation works across all macOS applications, replacing keyboard input with voice. All transcription runs on your Mac. AI summarization is available through cloud providers (OpenAI, Anthropic, Google, xAI, Mistral, Groq) or on-device via Ollama and LM Studio. QuickWhisper also includes batch transcription, Watch Folders for automatic background transcription, speaker diarization, Apple Shortcuts integration, and webhooks for third-party service integration.Starting Price: $39 one-time payment -
26
Phi-4-mini-reasoning
Microsoft
Phi-4-mini-reasoning is a 3.8-billion parameter transformer-based language model optimized for mathematical reasoning and step-by-step problem solving in environments with constrained computing or latency. Fine-tuned with synthetic data generated by the DeepSeek-R1 model, it balances efficiency with advanced reasoning ability. Trained on over one million diverse math problems spanning multiple levels of difficulty from middle school to Ph.D. level, Phi-4-mini-reasoning outperforms its base model on long sentence generation across various evaluations and surpasses larger models like OpenThinker-7B, Llama-3.2-3B-instruct, and DeepSeek-R1. It features a 128K-token context window and supports function calling, enabling integration with external tools and APIs. Phi-4-mini-reasoning can be quantized using Microsoft Olive or Apple MLX Framework for deployment on edge devices such as IoT, laptops, and mobile devices. -
27
Xilinx
Xilinx
The Xilinx’s AI development platform for AI inference on Xilinx hardware platforms consists of optimized IP, tools, libraries, models, and example designs. It is designed with high efficiency and ease-of-use in mind, unleashing the full potential of AI acceleration on Xilinx FPGA and ACAP. Supports mainstream frameworks and the latest models capable of diverse deep learning tasks. Provides a comprehensive set of pre-optimized models that are ready to deploy on Xilinx devices. You can find the closest model and start re-training for your applications! Provides a powerful open source quantizer that supports pruned and unpruned model quantization, calibration, and fine tuning. The AI profiler provides layer by layer analysis to help with bottlenecks. The AI library offers open source high-level C++ and Python APIs for maximum portability from edge to cloud. Efficient and scalable IP cores can be customized to meet your needs of many different applications. -
28
Apple Foundation Models
Apple
The Apple Foundation Models framework lets developers perform tasks with Apple’s on-device model that specializes in language understanding, structured output, and tool calling. It provides access to the on-device large language model that powers Apple Intelligence, helping apps perform intelligent tasks specific to their use case. The text-based on-device model identifies patterns that allow it to generate new text appropriate for the request, and it can make decisions to call code written by the developer to perform specialized tasks. Developers can generate text content for a wide range of tasks, including summarization, entity extraction, text understanding, refinement, dialog for games, creative content generation, classification, and more. It also supports guided generation, allowing developers to generate entire Swift data structures with strong guarantees by using the Generable macro.Starting Price: Free -
29
PanGu Chat
Huawei
PanGu Chat is an AI chatbot developed by Huawei. PanGu Chat can converse like a human and answer any questions like ChatGPT does. -
30
LegittMate AI
LegittMate AI
LegittMate AI is an AI-powered chatbot software designed to enhance sales processes by automating customer interactions and lead generation. It enables businesses to engage website visitors in real time, converting them into leads through effortless conversations and one-click lead capture. It offers live visitor insights and a dynamic dashboard, allowing sales teams to monitor visitor behavior and website analytics for informed decision-making. LegittMate AI seamlessly integrates with CRM systems, automating lead capture and follow-ups to streamline the sales pipeline. Additionally, it provides customizable design options to align the chatbot's appearance with the company's branding, ensuring a cohesive user experience. Empower sales associates with tools to engage in live conversations, prioritize quality leads, and focus on high-value interactions, saving time and boosting productivity.Starting Price: $29.99 per month -
31
Mixtral 8x7B
Mistral AI
Mixtral 8x7B is a high-quality sparse mixture of experts model (SMoE) with open weights. Licensed under Apache 2.0. Mixtral outperforms Llama 2 70B on most benchmarks with 6x faster inference. It is the strongest open-weight model with a permissive license and the best model overall regarding cost/performance trade-offs. In particular, it matches or outperforms GPT-3.5 on most standard benchmarks.Starting Price: Free -
32
ChatUp AI
ChatUp AI
ChatUp AI, built on GPT-3.5 and GPT-4, offers a versatile AI chatbot and writing assistant. It excels in AI content generation, language practice, and marketing/SEO tools. Unique is its AI character chat feature with over 120 characters, providing immersive interactions with favorite personas, and is expanding continuously. It also includes AI girlfriends and boyfriends for emotional companionship, mimicking real-life conversations. The platform is user-friendly, requiring no registration, allowing easy access to its array of features. Whether for creative writing, emotional engagement, or learning, it provides a comprehensive experience.Starting Price: $3.99/week -
33
ChatSonic
Writesonic
A revolutionary AI like ChatGPT - ChatSonic, the conversational AI chatbot addresses the limitations of ChatGPT, turning out to be the best Chat GPT alternative. Improving upon the limitations of Chat GPT and giving conversational AI wings with ChatSonic. ChatSonic is trained and powered by ‘Google Search’ to chat with you on current events and trending topics in real-time. ChatSonic - ChatGPT alternative can help generate stunning digital AI artwork for your social media posts and digital campaigns. A personal assistant you can customize and use whether you are solving a math problem, preparing for an interview, sorting relationship problems or helping you stay fit. Add the ChatSonic ChatGPT Chrome extension to get content suggestions from anywhere on the internet. ChatSonic understands voice commands and responds just like Siri / Google Assistant.Starting Price: $12.67 per month -
34
JoyzAI
JoyzAI
JoyzAI is an advanced customer support chatbot platform designed to deliver quick, accurate, and helpful responses to customer queries. It integrates seamlessly into websites and WhatsApp, offering 24/7 support in any language. The AI learns from each interaction, improving its responses over time and reducing the workload of support teams. By automating up to 80% of repetitive queries, JoyzAI empowers businesses to streamline their support operations, offering efficient, real-time analytics and insights into customer needs. It’s perfect for companies looking to scale their customer service without relying on large teams of human agents.Starting Price: ₹2499/month -
35
Sanctum
Sanctum
Sanctum is a private, local AI assistant that lets users run and interact with full-featured open source LLMs locally on their own device. It is built as a private Sanctum for AI, where data is encrypted, secure, and never leaves the user’s computer. It makes it easy to run AI locally, with an easy-to-download desktop solution that lets users run large language models on a Mac instantly without complicated installs, and after downloading, no internet connection is required. Sanctum is designed around privacy-first local processing: with on-device encryption and processing, users maintain complete privacy and control. Its Hugging Face integration gives access to thousands of GGUF models directly through Sanctum, making it possible to check compatibility, download models, and start using them on a PC or Mac. Sanctum also supports private PDF workflows, allowing users to chat with PDFs, ask questions, and summarize files in a secure environment. -
36
Llama 3.2
Meta
The open-source AI model you can fine-tune, distill and deploy anywhere is now available in more versions. Choose from 1B, 3B, 11B or 90B, or continue building with Llama 3.1. Llama 3.2 is a collection of large language models (LLMs) pretrained and fine-tuned in 1B and 3B sizes that are multilingual text only, and 11B and 90B sizes that take both text and image inputs and output text. Develop highly performative and efficient applications from our latest release. Use our 1B or 3B models for on device applications such as summarizing a discussion from your phone or calling on-device tools like calendar. Use our 11B or 90B models for image use cases such as transforming an existing image into something new or getting more information from an image of your surroundings.Starting Price: Free -
37
ChatGLM
Zhipu AI
ChatGLM-6B is an open-source, Chinese-English bilingual dialogue language model based on the General Language Model (GLM) architecture with 6.2 billion parameters. Combined with model quantization technology, users can deploy locally on consumer-grade graphics cards (only 6GB of video memory is required at the INT4 quantization level). ChatGLM-6B uses technology similar to ChatGPT, optimized for Chinese Q&A and dialogue. After about 1T identifiers of Chinese and English bilingual training, supplemented by supervision and fine-tuning, feedback self-help, human feedback reinforcement learning and other technologies, ChatGLM-6B with 6.2 billion parameters has been able to generate answers that are quite in line with human preferences.Starting Price: Free -
38
GigaChat
Sberbank
GigaChat knows how to answer user questions, maintain a dialogue, write program code, create texts and pictures based on descriptions within a single context. Unlike a foreign neural network, the GigaChat service initially already supports multimodal interaction and communicates more competently in Russian. The architecture of the GigaChat service is based on the neural network ensemble of the NeONKA (NEural Omnimodal Network with Knowledge-Awareness) model, which includes various neural network models and the method of supervised fine-tuning, reinforcement learning with human feedback. Thanks to this, Sber's new neural network can solve many intellectual tasks: keep up a conversation, write texts, answer factual questions. And the inclusion of the Kandinsky 2.1 model in the ensemble gives the neural network the skill of creating images. -
39
LFM2.5
Liquid AI
Liquid AI’s LFM2.5 is the next generation of on-device AI foundation models designed to deliver high-performance, efficient AI inference on edge devices such as phones, laptops, vehicles, IoT systems, and embedded hardware without relying on cloud compute. It extends the previous LFM2 architecture by significantly increasing the pretraining scale and reinforcement learning stages, yielding a family of hybrid models around 1.2 billion parameters that balance instruction following, reasoning, and multimodal capabilities for real-world agentic use cases. The LFM2.5 family includes Base (for fine-tuning and customization), Instruct (general-purpose instruction-tuned), Japanese-optimized, Vision-Language, and Audio-Language variants, all optimized for fast, on-device inference under tight memory constraints and available as open-weight models deployable via frameworks like llama.cpp, MLX, vLLM, and ONNX.Starting Price: Free -
40
Layla AI
Layla Network
Layla is an artificial intelligence that runs on your phone. No internet connection, fully private, and uncensored, you choose what you do with her. As AI technology advances at an amazing pace, privacy and security become the forefront concern. We want everyone to experience AI without worries about external influences, agendas, or censorship. That's why we created an artificial assistant that runs directly on your phone, without the need to connect to the internet. Layla can take on many personalities. Each personality is tailored to solve specific tasks. Layla is constantly evolving, so we aim for weekly updates with new features and improvements. Ability to search the internet in real-time, initiate conversations by reminding you of tasks, to-dos, or just a simple hello to make your day. Social features with state-of-the-art image generation and 3D models for all your favorite characters.Starting Price: $14.99 per month -
41
ChatGPT Plus
OpenAI
We’ve trained a model called ChatGPT which interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer followup questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests. ChatGPT is a sibling model to InstructGPT, which is trained to follow an instruction in a prompt and provide a detailed response. ChatGPT Plus is a subscription plan for ChatGPT a conversational AI. ChatGPT Plus costs $20/month, and subscribers will receive a number of benefits: - General access to ChatGPT, even during peak times - Faster response times - GPT-4 access - ChatGPT plugins - Web-browsing with ChatGPT - Priority access to new features and improvements ChatGPT Plus is available to customers in the United States, and we will begin the process of inviting people from our waitlist over the coming weeks. We plan to expand access and support to additional countries and regions soon.Starting Price: $20 per month -
42
Luminal
Luminal
Luminal is a machine-learning framework built for speed, simplicity, and composability, focusing on static graphs and compiler-based optimization to deliver high performance even for complex neural networks. It compiles models into minimal “primops” (only 12 primitive operations) and then applies compiler passes to replace those with device-specific optimized kernels, enabling efficient execution on GPU or other backends. It supports modules (building blocks of networks with a standard forward API) and the GraphTensor interface (typed tensors and graphs at compile time) for model definition and execution. Luminal’s core remains intentionally small and hackable, with extensibility via external compilers for datatypes, devices, training, quantization, and more. Quick-start guidance shows how to clone the repo, build a “Hello World” example, or run a larger model like LLaMA 3 using GPU features. -
43
Doubao
ByteDance
Doubao is an intelligent language model developed by ByteDance. It has been providing useful answers and insights to users across a wide range of topics. Doubao can handle complex questions, offer detailed explanations, and engage in meaningful conversations. With its advanced language understanding and generation capabilities, it continues to assist people in seeking knowledge, solving problems, and exploring new ideas. Whether for academic inquiries, creative inspiration, or simply having a conversation, Doubao is a valuable tool for users looking for accurate and helpful information.Starting Price: Free -
44
Claude Max
Anthropic
The Max Plan from Anthropic's Claude platform is designed for users who require extended access and higher usage limits for their AI-powered collaboration. Ideal for frequent and demanding tasks, the Max Plan offers up to 20 times higher usage than the standard Pro plan. With flexible usage levels, users can select the plan that fits their needs—whether they need additional usage for complex data, large documents, or extended conversations. The Max Plan also includes priority access to new features and models, ensuring users always have the latest tools at their disposal.Starting Price: $100/month -
45
ERNIE Bot
Baidu
ERNIE Bot is an AI-powered conversational assistant developed by Baidu, designed to facilitate seamless and natural interactions with users. Built on the ERNIE (Enhanced Representation through Knowledge Integration) model, ERNIE Bot excels at understanding complex queries and generating human-like responses across various domains. Its capabilities include processing text, generating images, and engaging in multimodal communication, making it suitable for a wide range of applications such as customer support, virtual assistants, and enterprise automation. With its advanced contextual understanding, ERNIE Bot offers an intuitive and efficient solution for businesses seeking to enhance their digital interactions and automate workflows.Starting Price: Free -
46
NVIDIA TensorRT
NVIDIA
NVIDIA TensorRT is an ecosystem of APIs for high-performance deep learning inference, encompassing an inference runtime and model optimizations that deliver low latency and high throughput for production applications. Built on the CUDA parallel programming model, TensorRT optimizes neural network models trained on all major frameworks, calibrating them for lower precision with high accuracy, and deploying them across hyperscale data centers, workstations, laptops, and edge devices. It employs techniques such as quantization, layer and tensor fusion, and kernel tuning on all types of NVIDIA GPUs, from edge devices to PCs to data centers. The ecosystem includes TensorRT-LLM, an open source library that accelerates and optimizes inference performance of recent large language models on the NVIDIA AI platform, enabling developers to experiment with new LLMs for high performance and quick customization through a simplified Python API.Starting Price: Free -
47
ZETIC.ai
ZETIC.ai
Easily switch to server-less AI and start saving money today. It works on any NPU device and any OS. ZETIC.ai solves AI companies’ problems with on-device AI solutions using NPUs. Say goodbye to the enormous expenses of maintaining GPU servers and AI cloud services. Our server-less AI system reduces your costs significantly. Our automated pipeline ensures that the entire process is completed within just one day, streamlining your transition to on-device AI. We provide a tailored AI pipeline from data processing to deployment, including hardware-specific optimization and an on-device AI runtime library, ensuring a seamless conversion to on-device AI. Easily implement on-target on-device AI model libraries with our automated pipeline, while reducing massive GPU server costs and enhancing security with serverless AI to upgrade your AI. With ZETIC.ai’s unique technology, AI models can be ported directly to on-device AI applications without any loss.Starting Price: Free -
48
Deci
Deci AI
Easily build, optimize, and deploy fast & accurate models with Deci’s deep learning development platform powered by Neural Architecture Search. Instantly achieve accuracy & runtime performance that outperform SoTA models for any use case and inference hardware. Reach production faster with automated tools. No more endless iterations and dozens of different libraries. Enable new use cases on resource-constrained devices or cut up to 80% of your cloud compute costs. Automatically find accurate & fast architectures tailored for your application, hardware and performance targets with Deci’s NAS based AutoNAC engine. Automatically compile and quantize your models using best-of-breed compilers and quickly evaluate different production settings. Automatically compile and quantize your models using best-of-breed compilers and quickly evaluate different production settings. -
49
Claude Pro
Anthropic
Claude Pro is an advanced large language model designed to handle complex tasks while maintaining a friendly, accessible demeanor. Trained on extensive, high-quality data, it excels at understanding context, interpreting subtle nuances, and producing well-structured, coherent responses across a wide range of topics. By leveraging robust reasoning capabilities and a refined knowledge base, Claude Pro can draft detailed reports, compose creative content, summarize lengthy documents, and even assist in coding tasks. Its adaptive algorithms continuously improve its ability to learn from feedback, ensuring that its output remains accurate, reliable, and helpful. Whether serving professionals seeking expert support or individuals looking for quick, informative answers, Claude Pro delivers a versatile and productive conversational experience.Starting Price: $18/month -
50
Diagnosis Pad
Diagnosis Pad
Diagnosis Pad uses private on-device AI to generate diagnoses, guidance, transcriptions and clinical notes in real-time. Privacy All AI processing happens offline and on your device. No data is sent to online servers for maximum privacy. How to Use Simply tap Start Session to begin transcribing your session and processing the on-device intelligence. Diagnosis As the session progresses, the top three diagnoses will be generated. You can explore these in detail to understand why it is being suggested for your specific context. Recommendations The top three recommendations will also be generated, and can be expanded for more detail as well. Notes A summary of the transcript is generated at the end of the session. Settings You can toggle having the diagnosis, recommendations and notes generated live in-session or when the session has completed.Starting Price: $0