OPTMeta
|
T5Google
|
|||||
| OPT | T5 | |||||
|---|---|---|---|---|---|---|
Related Products
|
||||||
OPT:
About
Large language models, which are often trained for hundreds of thousands of compute days, have shown remarkable capabilities for zero- and few-shot learning. Given their computational cost, these models are difficult to replicate without significant capital. For the few that are available through APIs, no access is granted to the full model weights, making them difficult to study. We present Open Pre-trained Transformers (OPT), a suite of decoder-only pre-trained transformers ranging from 125M to 175B parameters, which we aim to fully and responsibly share with interested researchers. We show that OPT-175B is comparable to GPT-3, while requiring only 1/7th the carbon footprint to develop. We are also releasing our logbook detailing the infrastructure challenges we faced, along with code for experimenting with all of the released models.
|
T5:
About
With T5, we propose reframing all NLP tasks into a unified text-to-text-format where the input and output are always text strings, in contrast to BERT-style models that can only output either a class label or a span of the input. Our text-to-text framework allows us to use the same model, loss function, and hyperparameters on any NLP task, including machine translation, document summarization, question answering, and classification tasks (e.g., sentiment analysis). We can even apply T5 to regression tasks by training it to predict the string representation of a number instead of the number itself.
|
|||||
OPT:
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
T5:
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
OPT:
Audience
AI developers interested in a large language model
|
T5:
Audience
AI developers interested in a powerful large language model
|
|||||
OPT:
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Not Supported
|
T5:
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Not Supported
|
|||||
OPT:
API
Offers API
Not Supported
|
T5:
API
Offers API
Not Supported
|
|||||
OPT:
Screenshots and VideosNo images available
|
T5:
Screenshots and VideosNo images available
|
|||||
OPT:
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
T5:
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
|||||
OPT:
Reviews/
|
T5:
Reviews/
|
|||||
OPT:
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
T5:
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
OPT:
Company InformationMeta
Founded: 2004
United States
www.meta.com
|
T5:
Company InformationGoogle
Founded: 1998
United States
ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html
|
|||||
OPT:
Alternatives |
T5:
Alternatives |
|||||
|
OPT:
|
T5:
|
|||||
|
OPT:
|
T5:
|
|||||
|
OPT:
|
T5:
|
|||||
|
OPT:
|
T5:
|
|||||
OPT:
Categories |
T5:
Categories |
|||||
OPT:
Integrations
Medical LLM
Not Supported
Spark NLP
Not Supported
|
T5: | |||||
|
OPT:
|
T5:
|