Foundry Local

Foundry Local

Microsoft
+
+

Related Products

  • StackAI
    55 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Runpod
    230 Ratings
    Visit Website
  • Google Cloud Speech-to-Text
    443 Ratings
    Visit Website
  • Google AI Studio
    41 Ratings
    Visit Website
  • Cloudflare
    2,048 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    1,161 Ratings
    Visit Website
  • Retool
    598 Ratings
    Visit Website
  • Anaconda
    625 Ratings
    Visit Website
  • RemotePeople
    546 Ratings
    Visit Website

About

Foundry Local is a local version of Azure AI Foundry that enables local execution of large language models (LLMs) directly on your Windows device. This on-device AI inference solution provides privacy, customization, and cost benefits compared to cloud-based alternatives. Best of all, it fits into your existing workflows and applications with an easy-to-use CLI and REST API.

About

Llama Stack is a modular framework designed to streamline the development of applications powered by Meta's Llama language models. It offers a client-server architecture with flexible configurations, allowing developers to mix and match various providers for components such as inference, memory, agents, telemetry, and evaluations. The framework includes pre-configured distributions tailored for different deployment scenarios, enabling seamless transitions from local development to production environments. Developers can interact with the Llama Stack server using client SDKs available in multiple programming languages, including Python, Node.js, Swift, and Kotlin. Comprehensive documentation and example applications are provided to assist users in building and deploying Llama-based applications efficiently.

Platforms Supported

Windows Supported
Mac Not Supported
Linux Not Supported
Cloud Not Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Supported
Mac Supported
Linux Not Supported
Cloud Not Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

AI enthusiasts and researchers looking for a solution to run their large language models

Audience

AI developers

Support

Phone Support Supported
24/7 Live Support Not Supported
Online Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

API

Offers API Supported

API

Offers API Not Supported

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Pricing

Free
Open source
Free Version Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Supported
Live Online Supported
In Person Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Company Information

Microsoft
Founded: 1975
United States
learn.microsoft.com/en-us/windows/ai/foundry-local/get-started

Company Information

Meta
Founded: 2004
United States
github.com/meta-llama/llama-stack

Alternatives

Alternatives

LEAP

LEAP

Liquid AI
NeuroSplit

NeuroSplit

Skymel
Llama 3

Llama 3

Meta

Categories

Categories

AI Development Supported

Integrations

Hugging Face Supported
Microsoft Foundry Supported
Mistral 7B Supported

Integrations

Hugging Face Not Supported
Microsoft Foundry Not Supported
Mistral 7B Not Supported
Claim Foundry Local and update features and information
Claim Foundry Local and update features and information
Claim Llama Stack and update features and information
Claim Llama Stack and update features and information