Foundry Local

Foundry Local

Microsoft
LiteRT

LiteRT

Google
+
+

Related Products

  • StackAI
    47 Ratings
    Visit Website
  • LM-Kit.NET
    23 Ratings
    Visit Website
  • RunPod
    205 Ratings
    Visit Website
  • Google Cloud Speech-to-Text
    373 Ratings
    Visit Website
  • Vertex AI
    783 Ratings
    Visit Website
  • Cloudflare
    1,915 Ratings
    Visit Website
  • Google AI Studio
    11 Ratings
    Visit Website
  • OORT DataHub
    13 Ratings
    Visit Website
  • Crowdin
    844 Ratings
    Visit Website
  • MongoDB Atlas
    1,648 Ratings
    Visit Website

About

Foundry Local is a local version of Azure AI Foundry that enables local execution of large language models (LLMs) directly on your Windows device. This on-device AI inference solution provides privacy, customization, and cost benefits compared to cloud-based alternatives. Best of all, it fits into your existing workflows and applications with an easy-to-use CLI and REST API.

About

LiteRT (Lite Runtime), formerly known as TensorFlow Lite, is Google's high-performance runtime for on-device AI. It enables developers to deploy machine learning models across various platforms and microcontrollers. LiteRT supports models from TensorFlow, PyTorch, and JAX, converting them into the efficient FlatBuffers format (.tflite) for optimized on-device inference. Key features include low latency, enhanced privacy by processing data locally, reduced model and binary sizes, and efficient power consumption. The runtime offers SDKs in multiple languages such as Java/Kotlin, Swift, Objective-C, C++, and Python, facilitating integration into diverse applications. Hardware acceleration is achieved through delegates like GPU and iOS Core ML, improving performance on supported devices. LiteRT Next, currently in alpha, introduces a new set of APIs that streamline on-device hardware acceleration.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

AI enthusiasts and researchers looking for a solution to run their large language models

Audience

Mobile application developers in search of a tool to integrate efficient, on-device AI capabilities into their apps

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Microsoft
Founded: 1975
United States
learn.microsoft.com/en-us/windows/ai/foundry-local/get-started

Company Information

Google
Founded: 1998
United States
ai.google.dev/edge/litert

Alternatives

Alternatives

AWS Neuron

AWS Neuron

Amazon Web Services
LEAP

LEAP

Liquid AI

Categories

Categories

Integrations

C++
Google AI Edge Gallery
Hugging Face
JAX
Java
Kotlin
Microsoft Foundry
Mistral 7B
Objective-C
PyTorch
Python
Swift
TensorFlow

Integrations

C++
Google AI Edge Gallery
Hugging Face
JAX
Java
Kotlin
Microsoft Foundry
Mistral 7B
Objective-C
PyTorch
Python
Swift
TensorFlow
Claim Foundry Local and update features and information
Claim Foundry Local and update features and information
Claim LiteRT and update features and information
Claim LiteRT and update features and information