GPT-NeoX

GPT-NeoX

EleutherAI
Llama

Llama

Meta
+
+

Related Products

  • Vertex AI
    727 Ratings
    Visit Website
  • LM-Kit.NET
    22 Ratings
    Visit Website
  • Google AI Studio
    9 Ratings
    Visit Website
  • Amazon Bedrock
    77 Ratings
    Visit Website
  • Spidergap
    116 Ratings
    Visit Website
  • RunPod
    167 Ratings
    Visit Website
  • Unimus
    30 Ratings
    Visit Website
  • eyefactive AppSuite
    20 Ratings
    Visit Website
  • Boozang
    15 Ratings
    Visit Website
  • Oxylabs
    988 Ratings
    Visit Website

About

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library. This repository records EleutherAI's library for training large-scale language models on GPUs. Our current framework is based on NVIDIA's Megatron Language Model and has been augmented with techniques from DeepSpeed as well as some novel optimizations. We aim to make this repo a centralized and accessible place to gather techniques for training large-scale autoregressive language models, and accelerate research into large-scale training.

About

Llama (Large Language Model Meta AI) is a state-of-the-art foundational large language model designed to help researchers advance their work in this subfield of AI. Smaller, more performant models such as Llama enable others in the research community who don’t have access to large amounts of infrastructure to study these models, further democratizing access in this important, fast-changing field. Training smaller foundation models like Llama is desirable in the large language model space because it requires far less computing power and resources to test new approaches, validate others’ work, and explore new use cases. Foundation models train on a large set of unlabeled data, which makes them ideal for fine-tuning for a variety of tasks. We are making Llama available at several sizes (7B, 13B, 33B, and 65B parameters) and also sharing a Llama model card that details how we built the model in keeping with our approach to Responsible AI practices.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Developers interested in a large language model

Audience

AI developers interested in a powerful large language model

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

No images available

Pricing

Free
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

EleutherAI
Founded: 2020
github.com/EleutherAI/gpt-neox

Company Information

Meta
Founded: 2004
United States
www.llama.com

Alternatives

GPT-J

GPT-J

EleutherAI

Alternatives

OPT

OPT

Meta
Alpaca

Alpaca

Stanford Center for Research on Foundation Models (CRFM)
Pythia

Pythia

EleutherAI
BitNet

BitNet

Microsoft
NVIDIA NeMo

NVIDIA NeMo

NVIDIA

Categories

Categories

Integrations

Arch
Batteries Included
Code Llama
Decompute Blackbird
Deep Infra
Diaflow
Evertune
FalkorDB
Gopher
HubSpot AI Search Grader
JustSimpleChat
Kong AI Gateway
Llama 4 Scout
Magai
Naptha
PostgresML
Snack Prompt
TigerData
Tune AI
Unframe

Integrations

Arch
Batteries Included
Code Llama
Decompute Blackbird
Deep Infra
Diaflow
Evertune
FalkorDB
Gopher
HubSpot AI Search Grader
JustSimpleChat
Kong AI Gateway
Llama 4 Scout
Magai
Naptha
PostgresML
Snack Prompt
TigerData
Tune AI
Unframe
Claim GPT-NeoX and update features and information
Claim GPT-NeoX and update features and information
Claim Llama and update features and information
Claim Llama and update features and information