Audience
AI enthusiasts and researchers looking for a solution to run their large language models
About Foundry Local
Foundry Local is a local version of Azure AI Foundry that enables local execution of large language models (LLMs) directly on your Windows device. This on-device AI inference solution provides privacy, customization, and cost benefits compared to cloud-based alternatives. Best of all, it fits into your existing workflows and applications with an easy-to-use CLI and REST API.
Other Popular Alternatives & Related Software
Microsoft Foundry Models
Microsoft Foundry Models is a unified model catalog that gives enterprises access to more than 11,000 AI models from Microsoft, OpenAI, Anthropic, Mistral AI, Meta, Cohere, DeepSeek, xAI, and others. It allows teams to explore, test, and deploy models quickly using a task-centric discovery experience and integrated playground. Organizations can fine-tune models with ready-to-use pipelines and evaluate performance using their own datasets for more accurate benchmarking. Foundry Models provides secure, scalable deployment options with serverless and managed compute choices tailored to enterprise needs. With built-in governance, compliance, and Azure’s global security framework, businesses can safely operationalize AI across mission-critical workflows. The platform accelerates innovation by enabling developers to build, iterate, and scale AI solutions from one centralized environment.
Learn more
Mirai
Mirai is a developer-focused on-device AI infrastructure platform designed to convert, optimize, and run machine learning models directly on Apple devices with high performance and privacy. It provides a unified pipeline that enables teams to convert and quantize models, benchmark them, distribute them, and execute inference locally. It is built specifically for Apple Silicon and aims to deliver near-zero latency, zero inference cost, and full data privacy by keeping sensitive processing on the user’s device. Through its SDK and inference engine, developers can integrate AI features into applications quickly, using hardware-aware optimizations that unlock the full power of the GPU and Neural Engine. Mirai also includes dynamic routing capabilities that automatically decide whether a request should run locally or in the cloud based on latency, privacy, or workload requirements.
Learn more
LEAP
The LEAP Edge AI Platform offers a full-stack on-device AI toolchain that enables developers to build edge AI applications, from model selection through inference, entirely on device. It includes a best-model search engine to find the most appropriate model for a given task and device constraint, a curated library of pre-trained model bundles ready for download, and fine-tuning tools (such as GPU-optimized scripts) for customizing models like LFM2 to specific use cases. It supports vision-enabled capabilities across iOS, Android, and laptop devices, and includes function-calling so AI models can interact with external systems via structured outputs. For deployment, LEAP provides an Edge SDK that lets developers load and query models locally, just like a cloud API, but entirely offline, and a model bundling service to package any supported model or checkpoint into a bundle optimized for edge deployment.
Learn more
Microsoft Foundry
Microsoft Foundry is an end-to-end platform for building, optimizing, and governing AI apps and agents at scale. It gives developers access to more than 11,000 models — from foundational to multimodal — all available through one unified interface. With a simple, interoperable API and SDK, teams can build faster, ship confidently, and reduce integration complexity. Foundry connects seamlessly with your business systems, enabling AI solutions that understand your data and operate securely across your organization. Built-in governance, monitoring, and fleetwide controls ensure responsible AI deployment from day one. Microsoft Foundry helps companies turn AI into real business impact with speed, security, and precision.
Learn more
Company Information
Microsoft
Founded: 1975
United States
learn.microsoft.com/en-us/windows/ai/foundry-local/get-started
Videos and Screen Captures
Other Useful Business Software
$300 in Free Credit Towards Top Cloud Services
Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
Product Details
Platforms Supported
Windows
Training
Documentation
Live Online
Webinars
In Person
Videos
Support
Phone Support
Online
