Amazon EC2 Trn2 InstancesAmazon
|
||||||
Related Products
|
||||||
About
Amazon EC2 Trn2 instances, powered by AWS Trainium2 chips, are purpose-built for high-performance deep learning training of generative AI models, including large language models and diffusion models. They offer up to 50% cost-to-train savings over comparable Amazon EC2 instances. Trn2 instances support up to 16 Trainium2 accelerators, providing up to 3 petaflops of FP16/BF16 compute power and 512 GB of high-bandwidth memory. To facilitate efficient data and model parallelism, Trn2 instances feature NeuronLink, a high-speed, nonblocking interconnect, and support up to 1600 Gbps of second-generation Elastic Fabric Adapter (EFAv2) network bandwidth. They are deployed in EC2 UltraClusters, enabling scaling up to 30,000 Trainium2 chips interconnected with a nonblocking petabit-scale network, delivering 6 exaflops of compute performance. The AWS Neuron SDK integrates natively with popular machine learning frameworks like PyTorch and TensorFlow.
|
About
tensorViz helps developers explore PyTorch models and JAX/Flax programs as interactive graphs. For PyTorch, users can expand nested modules, inspect tensor shapes captured from one forward pass, jump to Python source, and review architecture changes beside code diffs. The website offers recorded model graphs to explore without installation. The free VS Code extension is available from the Visual Studio Marketplace and Open VSX. Local capture requires Python, model dependencies, and example inputs. Standalone coding-agent plugins are an Apple Silicon macOS preview; MCP agents can also connect to the extension. JAX/Flax graphs use CPU tracing with inferred shapes, and PyTorch source edits are unavailable for them.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Supported
Mac
Supported
Linux
Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
Companies in search of a solution to train their large-scale deep learning and generative AI models
|
Audience
Machine learning engineers, PyTorch developers, researchers and students exploring model architecture, tensor shapes and architecture changes.
|
|||||
Support
Phone Support
Supported
24/7 Live Support
Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
|||||
API
Offers API
Not Supported
|
API
Offers API
Supported
|
|||||
Screenshots and Videos |
Screenshots and VideosNo images available
|
|||||
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
Pricing
$0
The VS Code extension is free to install. Core graph exploration and source-edit forms work without an agent or provider API key; connecting a coding agent is optional.
Free Version
Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Supported
Live Online
Not Supported
In Person
Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationAmazon
Founded: 1994
United States
aws.amazon.com/ec2/instance-types/trn2/
|
Company InformationtensorViz
tensorviz.dev/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
||||||
|
|
||||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
AWS Batch
Supported
AWS Deep Learning AMIs
Supported
AWS Neuron
Supported
AWS Nitro System
Supported
Amazon EC2 Capacity Blocks for ML
Supported
Amazon EC2 G5 Instances
Supported
Amazon EC2 P4 Instances
Supported
Amazon EC2 UltraClusters
Supported
Amazon Elastic Container Service (Amazon ECS)
Supported
Amazon SageMaker
Supported
|
Integrations
AWS Batch
Not Supported
AWS Deep Learning AMIs
Not Supported
AWS Neuron
Not Supported
AWS Nitro System
Not Supported
Amazon EC2 Capacity Blocks for ML
Not Supported
Amazon EC2 G5 Instances
Not Supported
Amazon EC2 P4 Instances
Not Supported
Amazon EC2 UltraClusters
Not Supported
Amazon Elastic Container Service (Amazon ECS)
Not Supported
Amazon SageMaker
Not Supported
|
|||||
|
|
|