AWS NeuronAmazon Web Services
|
LiteRTGoogle
|
|||||
Related Products
|
||||||
About
It supports high-performance training on AWS Trainium-based Amazon Elastic Compute Cloud (Amazon EC2) Trn1 instances. For model deployment, it supports high-performance and low-latency inference on AWS Inferentia-based Amazon EC2 Inf1 instances and AWS Inferentia2-based Amazon EC2 Inf2 instances. With Neuron, you can use popular frameworks, such as TensorFlow and PyTorch, and optimally train and deploy machine learning (ML) models on Amazon EC2 Trn1, Inf1, and Inf2 instances with minimal code changes and without tie-in to vendor-specific solutions. AWS Neuron SDK, which supports Inferentia and Trainium accelerators, is natively integrated with PyTorch and TensorFlow. This integration ensures that you can continue using your existing workflows in these popular frameworks and get started with only a few lines of code changes. For distributed model training, the Neuron SDK supports libraries, such as Megatron-LM and PyTorch Fully Sharded Data Parallel (FSDP).
|
About
LiteRT (Lite Runtime), formerly known as TensorFlow Lite, is Google's high-performance runtime for on-device AI. It enables developers to deploy machine learning models across various platforms and microcontrollers. LiteRT supports models from TensorFlow, PyTorch, and JAX, converting them into the efficient FlatBuffers format (.tflite) for optimized on-device inference. Key features include low latency, enhanced privacy by processing data locally, reduced model and binary sizes, and efficient power consumption. The runtime offers SDKs in multiple languages such as Java/Kotlin, Swift, Objective-C, C++, and Python, facilitating integration into diverse applications. Hardware acceleration is achieved through delegates like GPU and iOS Core ML, improving performance on supported devices. LiteRT Next, currently in alpha, introduces a new set of APIs that streamline on-device hardware acceleration.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Organizations in need of an SDK solution with a compiler, runtime, and profiling tools that unlocks high-performance and cost-effective deep learning acceleration
|
Audience
Mobile application developers in search of a tool to integrate efficient, on-device AI capabilities into their apps
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
Free
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationAmazon Web Services
Founded: 2006
United States
aws.amazon.com/machine-learning/neuron/
|
Company InformationGoogle
Founded: 1998
United States
ai.google.dev/edge/litert
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
AWS Trainium
Amazon EC2 Capacity Blocks for ML
Amazon EC2 G5 Instances
Amazon EC2 Inf1 Instances
Amazon EC2 P4 Instances
Amazon EC2 P5 Instances
Amazon EC2 Trn1 Instances
Amazon EKS
Amazon EKS Anywhere
Amazon SageMaker
|
Integrations
AWS Trainium
Amazon EC2 Capacity Blocks for ML
Amazon EC2 G5 Instances
Amazon EC2 Inf1 Instances
Amazon EC2 P4 Instances
Amazon EC2 P5 Instances
Amazon EC2 Trn1 Instances
Amazon EKS
Amazon EKS Anywhere
Amazon SageMaker
|
|||||
|
|
|