Audience
AI enthusiasts and researchers looking for a solution to run their large language models
About Foundry Local
Foundry Local is a local version of Azure AI Foundry that enables local execution of large language models (LLMs) directly on your Windows device. This on-device AI inference solution provides privacy, customization, and cost benefits compared to cloud-based alternatives. Best of all, it fits into your existing workflows and applications with an easy-to-use CLI and REST API.
Other Popular Alternatives & Related Software
LEAP
The LEAP Edge AI Platform offers a full-stack on-device AI toolchain that enables developers to build edge AI applications, from model selection through inference, entirely on device. It includes a best-model search engine to find the most appropriate model for a given task and device constraint, a curated library of pre-trained model bundles ready for download, and fine-tuning tools (such as GPU-optimized scripts) for customizing models like LFM2 to specific use cases. It supports vision-enabled capabilities across iOS, Android, and laptop devices, and includes function-calling so AI models can interact with external systems via structured outputs. For deployment, LEAP provides an Edge SDK that lets developers load and query models locally, just like a cloud API, but entirely offline, and a model bundling service to package any supported model or checkpoint into a bundle optimized for edge deployment.
Learn more
TensorFlow
An end-to-end open source machine learning platform. TensorFlow is an end-to-end open source platform for machine learning. It has a comprehensive, flexible ecosystem of tools, libraries and community resources that lets researchers push the state-of-the-art in ML and developers easily build and deploy ML powered applications. Build and train ML models easily using intuitive high-level APIs like Keras with eager execution, which makes for immediate model iteration and easy debugging. Easily train and deploy models in the cloud, on-prem, in the browser, or on-device no matter what language you use. A simple and flexible architecture to take new ideas from concept to code, to state-of-the-art models, and to publication faster. Build, deploy, and experiment easily with TensorFlow.
Learn more
Mirai
Mirai is a developer-focused on-device AI infrastructure platform designed to convert, optimize, and run machine learning models directly on Apple devices with high performance and privacy. It provides a unified pipeline that enables teams to convert and quantize models, benchmark them, distribute them, and execute inference locally. It is built specifically for Apple Silicon and aims to deliver near-zero latency, zero inference cost, and full data privacy by keeping sensitive processing on the user’s device. Through its SDK and inference engine, developers can integrate AI features into applications quickly, using hardware-aware optimizations that unlock the full power of the GPU and Neural Engine. Mirai also includes dynamic routing capabilities that automatically decide whether a request should run locally or in the cloud based on latency, privacy, or workload requirements.
Learn more
Microsoft Foundry
Microsoft Foundry is an end-to-end platform for building, optimizing, and governing AI apps and agents at scale. It gives developers access to more than 11,000 models — from foundational to multimodal — all available through one unified interface. With a simple, interoperable API and SDK, teams can build faster, ship confidently, and reduce integration complexity. Foundry connects seamlessly with your business systems, enabling AI solutions that understand your data and operate securely across your organization. Built-in governance, monitoring, and fleetwide controls ensure responsible AI deployment from day one. Microsoft Foundry helps companies turn AI into real business impact with speed, security, and precision.
Learn more
Company Information
Microsoft
Founded: 1975
United States
learn.microsoft.com/en-us/windows/ai/foundry-local/get-started
Other Useful Business Software
$300 Free Credits for Your Google Cloud Projects
Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
Product Details
Platforms Supported
Windows
Training
Documentation
Live Online
Webinars
In Person
Videos
Support
Phone Support
Online