Download
AWS Neuron is a software development kit (SDK) for running machine learning inference using AWS Inferentia chips. It consists of a compiler, run-time, and profiling tools that enable developers to run high-performance and low latency inference using AWS Inferentia-based Amazon EC2 Inf1 instances. Using Neuron developers can easily train their machine learning models on any popular framework such as TensorFlow, PyTorch, and MXNet, and run it optimally on Amazon EC2 Inf1 instances. You can continue to use the same ML frameworks you use today and migrate your software onto Inf1 instances with minimal code changes and without tie-in to vendor-specific solutions. Neuron is pre-integrated into popular machine learning frameworks like TensorFlow, MXNet and Pytorch to provide a seamless training-to-inference workflow. It includes a compiler, runtime driver, as well as debug and profiling utilities with a TensorBoard plugin for visualization.
Features
- The fastest and easiest way to get started with Inf1 instances is Amazon SageMaker
- The AWS Neuron SDK is integrated with popular frameworks such as TensorFlow, PyTorch, and MXNet
- It is preinstalled in Amazon Deep Learning AMIs and Amazon Deep Learning Containers
- The AWS Neuron SDK enables efficient programming and runtime access to the Inferentia chips
- Since Neuron is integrated with common machine learning frameworks, developers deploy their existing models to EC2 Inf1 instances with minimal code changes
- Provides customers the ability to compile and run inference using pretrained models
Project Samples
