| AWS NeuronAmazon Web Services | NVIDIA GPU-Optimized AMIAmazon | |||||
| Related Products
 | ||||||
| About
            It supports high-performance training on AWS Trainium-based Amazon Elastic Compute Cloud (Amazon EC2) Trn1 instances. For model deployment, it supports high-performance and low-latency inference on AWS Inferentia-based Amazon EC2 Inf1 instances and AWS Inferentia2-based Amazon EC2 Inf2 instances. With Neuron, you can use popular frameworks, such as TensorFlow and PyTorch, and optimally train and deploy machine learning (ML) models on Amazon EC2 Trn1, Inf1, and Inf2 instances with minimal code changes and without tie-in to vendor-specific solutions. AWS Neuron SDK, which supports Inferentia and Trainium accelerators, is natively integrated with PyTorch and TensorFlow. This integration ensures that you can continue using your existing workflows in these popular frameworks and get started with only a few lines of code changes. For distributed model training, the Neuron SDK supports libraries, such as Megatron-LM and PyTorch Fully Sharded Data Parallel (FSDP).
             | About
            The NVIDIA GPU-Optimized AMI is a virtual machine image for accelerating your GPU accelerated Machine Learning, Deep Learning, Data Science and HPC workloads. Using this AMI, you can spin up a GPU-accelerated EC2 VM instance in minutes with a pre-installed Ubuntu OS, GPU driver, Docker and NVIDIA container toolkit.
This AMI provides easy access to NVIDIA's NGC Catalog, a hub for GPU-optimized software, for pulling & running performance-tuned, tested, and NVIDIA certified docker containers. The NGC catalog provides free access to containerized AI, Data Science, and HPC applications, pre-trained models, AI SDKs and other resources to enable data scientists, developers, and researchers to focus on building and deploying solutions.
This GPU-optimized AMI is free with an option to purchase enterprise support offered through NVIDIA AI Enterprise. For how to get support for this AMI, scroll down to 'Support Information'
             | |||||
| Platforms Supported
            
                Windows
            
            
         
            
                Mac
            
            
         
            
                Linux
            
            
         
            
                Cloud
            
            
         
            
                On-Premises
            
            
         
            
                iPhone
            
            
         
            
                iPad
            
            
         
            
                Android
            
            
         
            
                Chromebook
            
            
         | Platforms Supported
            
                Windows
            
            
         
            
                Mac
            
            
         
            
                Linux
            
            
         
            
                Cloud
            
            
         
            
                On-Premises
            
            
         
            
                iPhone
            
            
         
            
                iPad
            
            
         
            
                Android
            
            
         
            
                Chromebook
            
            
         | |||||
| Audience
        Organizations in need of an SDK solution with a compiler, runtime, and profiling tools that unlocks high-performance and cost-effective deep learning acceleration
         | Audience
        Organizations and individuals in need of an optimized environment for running deep learning and data science containers
         | |||||
| Support
            
                Phone Support
            
            
         
            
                24/7 Live Support
            
            
         
            
                Online
            
            
         | Support
            
                Phone Support
            
            
         
            
                24/7 Live Support
            
            
         
            
                Online
            
            
         | |||||
| API
            
                Offers API
            
            
         | API
            
                Offers API
            
            
         | |||||
| Screenshots and Videos | Screenshots and Videos | |||||
| Pricing
        No information available.
        
        
     
            
                Free Version
            
            
         
            
                Free Trial
            
            
         | Pricing
        $3.06 per hour
        
     
            
                Free Version
            
            
         
            
                Free Trial
            
            
         | |||||
| 
Reviews/ | 
Reviews/ | |||||
| Training
            
                Documentation
            
            
         
            
                Webinars
            
            
         
            
                Live Online
            
            
         
            
                In Person
            
            
         | Training
            
                Documentation
            
            
         
            
                Webinars
            
            
         
            
                Live Online
            
            
         
            
                In Person
            
            
         | |||||
| Company InformationAmazon Web Services Founded: 2006 United States aws.amazon.com/machine-learning/neuron/ | Company InformationAmazon Founded: 1994 United States aws.amazon.com/marketplace/pp/prodview-7ikjtg3um26wq | |||||
| Alternatives | Alternatives | |||||
|  | ||||||
|  |  | |||||
|  |  | |||||
|  | ||||||
| Categories | Categories | |||||
| Integrations
            
                
    Amazon Web Services (AWS)
            
            
         
            
                
    AWS Deep Learning AMIs
            
            
         
            
                
    AWS Deep Learning Containers
            
            
         
            
                
    AWS Marketplace
            
            
         
            
                
    AWS Trainium
            
            
         
            
                
    Amazon EC2 Capacity Blocks for ML
            
            
         
            
                
    Amazon EC2 G5 Instances
            
            
         
            
                
    Amazon EC2 Inf1 Instances
            
            
         
            
                
    Amazon EC2 P4 Instances
            
            
         
            
                
    Amazon EC2 P5 Instances
            
            
         | Integrations
            
                
    Amazon Web Services (AWS)
            
            
         
            
                
    AWS Deep Learning AMIs
            
            
         
            
                
    AWS Deep Learning Containers
            
            
         
            
                
    AWS Marketplace
            
            
         
            
                
    AWS Trainium
            
            
         
            
                
    Amazon EC2 Capacity Blocks for ML
            
            
         
            
                
    Amazon EC2 G5 Instances
            
            
         
            
                
    Amazon EC2 Inf1 Instances
            
            
         
            
                
    Amazon EC2 P4 Instances
            
            
         
            
                
    Amazon EC2 P5 Instances
            
            
         | |||||
|  |  | 
 
        