Audience
AI enthusiasts and researchers looking for a solution to run their large language models
About Foundry Local
Foundry Local is a local version of Azure AI Foundry that enables local execution of large language models (LLMs) directly on your Windows device. This on-device AI inference solution provides privacy, customization, and cost benefits compared to cloud-based alternatives. Best of all, it fits into your existing workflows and applications with an easy-to-use CLI and REST API.
Other Popular Alternatives & Related Software
Microsoft Foundry Models
Microsoft Foundry Models is a unified model catalog that gives enterprises access to more than 11,000 AI models from Microsoft, OpenAI, Anthropic, Mistral AI, Meta, Cohere, DeepSeek, xAI, and others. It allows teams to explore, test, and deploy models quickly using a task-centric discovery experience and integrated playground. Organizations can fine-tune models with ready-to-use pipelines and evaluate performance using their own datasets for more accurate benchmarking. Foundry Models provides secure, scalable deployment options with serverless and managed compute choices tailored to enterprise needs. With built-in governance, compliance, and Azure’s global security framework, businesses can safely operationalize AI across mission-critical workflows. The platform accelerates innovation by enabling developers to build, iterate, and scale AI solutions from one centralized environment.
Learn more
Microsoft Foundry
Microsoft Foundry is an end-to-end platform for building, optimizing, and governing AI apps and agents at scale. It gives developers access to more than 11,000 models — from foundational to multimodal — all available through one unified interface. With a simple, interoperable API and SDK, teams can build faster, ship confidently, and reduce integration complexity. Foundry connects seamlessly with your business systems, enabling AI solutions that understand your data and operate securely across your organization. Built-in governance, monitoring, and fleetwide controls ensure responsible AI deployment from day one. Microsoft Foundry helps companies turn AI into real business impact with speed, security, and precision.
Learn more
TensorFlow
An end-to-end open source machine learning platform. TensorFlow is an end-to-end open source platform for machine learning. It has a comprehensive, flexible ecosystem of tools, libraries and community resources that lets researchers push the state-of-the-art in ML and developers easily build and deploy ML powered applications. Build and train ML models easily using intuitive high-level APIs like Keras with eager execution, which makes for immediate model iteration and easy debugging. Easily train and deploy models in the cloud, on-prem, in the browser, or on-device no matter what language you use. A simple and flexible architecture to take new ideas from concept to code, to state-of-the-art models, and to publication faster. Build, deploy, and experiment easily with TensorFlow.
Learn more
LEAP
The LEAP Edge AI Platform offers a full-stack on-device AI toolchain that enables developers to build edge AI applications, from model selection through inference, entirely on device. It includes a best-model search engine to find the most appropriate model for a given task and device constraint, a curated library of pre-trained model bundles ready for download, and fine-tuning tools (such as GPU-optimized scripts) for customizing models like LFM2 to specific use cases. It supports vision-enabled capabilities across iOS, Android, and laptop devices, and includes function-calling so AI models can interact with external systems via structured outputs. For deployment, LEAP provides an Edge SDK that lets developers load and query models locally, just like a cloud API, but entirely offline, and a model bundling service to package any supported model or checkpoint into a bundle optimized for edge deployment.
Learn more
Company Information
Microsoft
Founded: 1975
United States
learn.microsoft.com/en-us/windows/ai/foundry-local/get-started
Videos and Screen Captures
Other Useful Business Software
Auth0 for AI Agents now in GA
Connect your AI agents to apps and data more securely, give users control over the actions AI agents can perform and the data they can access, and enable human confirmation for critical agent actions.
Product Details
Platforms Supported
Windows
Training
Documentation
Live Online
Webinars
In Person
Videos
Support
Phone Support
Online
