Amazon EC2 Trn1 InstancesAmazon
|
CodeT5Salesforce
|
|||||
Related Products
|
||||||
About
Amazon Elastic Compute Cloud (EC2) Trn1 instances, powered by AWS Trainium chips, are purpose-built for high-performance deep learning training of generative AI models, including large language models and latent diffusion models. Trn1 instances offer up to 50% cost-to-train savings over other comparable Amazon EC2 instances. You can use Trn1 instances to train 100B+ parameter DL and generative AI models across a broad set of applications, such as text summarization, code generation, question answering, image and video generation, recommendation, and fraud detection. The AWS Neuron SDK helps developers train models on AWS Trainium (and deploy models on the AWS Inferentia chips). It integrates natively with frameworks such as PyTorch and TensorFlow so that you can continue using your existing code and workflows to train models on Trn1 instances.
|
About
Code for CodeT5, a new code-aware pre-trained encoder-decoder model. Identifier-aware unified pre-trained encoder-decoder models for code understanding and generation. This is the official PyTorch implementation for the EMNLP 2021 paper from Salesforce Research. CodeT5-large-ntp-py is specially optimized for Python code generation tasks and employed as the foundation model for our CodeRL, yielding new SOTA results on the APPS Python competition-level program synthesis benchmark. This repo provides the code for reproducing the experiments in CodeT5. CodeT5 is a new pre-trained encoder-decoder model for programming languages, which is pre-trained on 8.35M functions in 8 programming languages (Python, Java, JavaScript, PHP, Ruby, Go, C, and C#). In total, it achieves state-of-the-art results on 14 sub-tasks in a code intelligence benchmark - CodeXGLUE. Generate code based on the natural language description.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Organizations and developers requiring a solution for training large-scale deep learning and generative AI models
|
Audience
Developers and users interested in a solution to generate, summarize, and autocomplete code
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
$1.34 per hour
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationAmazon
Founded: 1994
United States
aws.amazon.com/ec2/instance-types/trn1/
|
Company InformationSalesforce
github.com/salesforce/CodeT5
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
||||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
AWS Deep Learning Containers
AWS Inferentia
AWS Neuron
Amazon EC2 Capacity Blocks for ML
Amazon EC2 G5 Instances
Amazon EC2 P4 Instances
Amazon EC2 P5 Instances
Amazon EC2 Trn2 Instances
Amazon EC2 UltraClusters
Amazon SageMaker
|
Integrations
AWS Deep Learning Containers
AWS Inferentia
AWS Neuron
Amazon EC2 Capacity Blocks for ML
Amazon EC2 G5 Instances
Amazon EC2 P4 Instances
Amazon EC2 P5 Instances
Amazon EC2 Trn2 Instances
Amazon EC2 UltraClusters
Amazon SageMaker
|
|||||
|
|
|