Amazon EC2 Inf1 InstancesAmazon
|
||||||
Related Products
|
||||||
About
Amazon EC2 Inf1 instances are purpose-built to deliver high-performance and cost-effective machine learning inference. They provide up to 2.3 times higher throughput and up to 70% lower cost per inference compared to other Amazon EC2 instances. Powered by up to 16 AWS Inferentia chips, ML inference accelerators designed by AWS, Inf1 instances also feature 2nd generation Intel Xeon Scalable processors and offer up to 100 Gbps networking bandwidth to support large-scale ML applications. These instances are ideal for deploying applications such as search engines, recommendation systems, computer vision, speech recognition, natural language processing, personalization, and fraud detection. Developers can deploy their ML models on Inf1 instances using the AWS Neuron SDK, which integrates with popular ML frameworks like TensorFlow, PyTorch, and Apache MXNet, allowing for seamless migration with minimal code changes.
|
About
tensorViz helps developers explore PyTorch models and JAX/Flax programs as interactive graphs. For PyTorch, users can expand nested modules, inspect tensor shapes captured from one forward pass, jump to Python source, and review architecture changes beside code diffs. The website offers recorded model graphs to explore without installation. The free VS Code extension is available from the Visual Studio Marketplace and Open VSX. Local capture requires Python, model dependencies, and example inputs. Standalone coding-agent plugins are an Apple Silicon macOS preview; MCP agents can also connect to the extension. JAX/Flax graphs use CPU tracing with inferred shapes, and PyTorch source edits are unavailable for them.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Supported
Mac
Supported
Linux
Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
Companies in need of a tool to deploy large-scale machine learning inference applications with high performance
|
Audience
Machine learning engineers, PyTorch developers, researchers and students exploring model architecture, tensor shapes and architecture changes.
|
|||||
Support
Phone Support
Supported
24/7 Live Support
Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
|||||
API
Offers API
Not Supported
|
API
Offers API
Supported
|
|||||
Screenshots and Videos |
Screenshots and VideosNo images available
|
|||||
Pricing
$0.228 per hour
Free Version
Not Supported
Free Trial
Not Supported
|
Pricing
$0
The VS Code extension is free to install. Core graph exploration and source-edit forms work without an agent or provider API key; connecting a coding agent is optional.
Free Version
Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Supported
Live Online
Not Supported
In Person
Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationAmazon
Founded: 1994
United States
aws.amazon.com/ec2/instance-types/inf1/
|
Company InformationtensorViz
tensorviz.dev/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
||||||
|
|
||||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
AWS Deep Learning AMIs
Supported
AWS Inferentia
Supported
AWS Neuron
Supported
AWS Trainium
Supported
Amazon EC2 Capacity Blocks for ML
Supported
Amazon EC2 G5 Instances
Supported
Amazon EC2 P4 Instances
Supported
Amazon EC2 Trn1 Instances
Supported
Amazon EC2 Trn2 Instances
Supported
Amazon EC2 UltraClusters
Supported
|
Integrations
AWS Deep Learning AMIs
Not Supported
AWS Inferentia
Not Supported
AWS Neuron
Not Supported
AWS Trainium
Not Supported
Amazon EC2 Capacity Blocks for ML
Not Supported
Amazon EC2 G5 Instances
Not Supported
Amazon EC2 P4 Instances
Not Supported
Amazon EC2 Trn1 Instances
Not Supported
Amazon EC2 Trn2 Instances
Not Supported
Amazon EC2 UltraClusters
Not Supported
|
|||||
|
|
|