Yi-Large

Yi-Large

01.AI
+
+

Related Products

  • Vertex AI
    944 Ratings
    Visit Website
  • Google AI Studio
    11 Ratings
    Visit Website
  • LM-Kit.NET
    25 Ratings
    Visit Website
  • DataHub
    10 Ratings
    Visit Website
  • SBS Financing Platform
    3 Ratings
    Visit Website
  • Enterprise Bot
    23 Ratings
    Visit Website
  • QuickApps
    Visit Website
  • Iru
    1,488 Ratings
    Visit Website
  • Ango Hub
    15 Ratings
    Visit Website
  • Nexo
    16,505 Ratings
    Visit Website

About

This repository contains the research preview of LongLLaMA, a large language model capable of handling long contexts of 256k tokens or even more. LongLLaMA is built upon the foundation of OpenLLaMA and fine-tuned using the Focused Transformer (FoT) method. LongLLaMA code is built upon the foundation of Code Llama. We release a smaller 3B base variant (not instruction tuned) of the LongLLaMA model on a permissive license (Apache 2.0) and inference code supporting longer contexts on hugging face. Our model weights can serve as the drop-in replacement of LLaMA in existing implementations (for short context up to 2048 tokens). Additionally, we provide evaluation results and comparisons against the original OpenLLaMA models.

About

Yi-Large is a proprietary large language model developed by 01.AI, offering a 32k context length with both input and output costs at $2 per million tokens. It stands out with its advanced capabilities in natural language processing, common-sense reasoning, and multilingual support, performing on par with leading models like GPT-4 and Claude3 in various benchmarks. Yi-Large is designed for tasks requiring complex inference, prediction, and language understanding, making it suitable for applications like knowledge search, data classification, and creating human-like chatbots. Its architecture is based on a decoder-only transformer with enhancements such as pre-normalization and Group Query Attention, and it has been trained on a vast, high-quality multilingual dataset. This model's versatility and cost-efficiency make it a strong contender in the AI market, particularly for enterprises aiming to deploy AI solutions globally.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Users interested in a powerful Large Language Model solution

Audience

Developers, researchers, and enterprises seeking a high-performance AI model for advanced natural language processing, coding, and data-driven decision-making

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version
Free Trial

Pricing

$0.19 per 1M input token
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

LongLLaMA
github.com/CStanKonrad/long_llama

Company Information

01.AI
Founded: 2023
China
www.01.ai/

Alternatives

Llama 2

Llama 2

Meta

Alternatives

CodeQwen

CodeQwen

Alibaba
Mistral Large 2

Mistral Large 2

Mistral AI
Kimi K2

Kimi K2

Moonshot AI
PaLM 2

PaLM 2

Google
Olmo 3

Olmo 3

Ai2
Qwen2

Qwen2

Alibaba

Categories

Categories

Integrations

DeepSeek R1
GitHub
Hugging Face
LLaMA-Factory
ModelScope

Integrations

DeepSeek R1
GitHub
Hugging Face
LLaMA-Factory
ModelScope
Claim LongLLaMA and update features and information
Claim LongLLaMA and update features and information
Claim Yi-Large and update features and information
Claim Yi-Large and update features and information