+
+

Related Products

  • Gemini Enterprise Agent Platform
    999 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • LTX
    182 Ratings
    Visit Website
  • Google AI Studio
    41 Ratings
    Visit Website
  • Checksum.ai
    1 Rating
    Visit Website
  • Iris Identity Protection
    3 Ratings
    Visit Website
  • JetBrains Junie
    12 Ratings
    Visit Website
  • SBS Asset Finance
    3 Ratings
    Visit Website
  • DataHub
    10 Ratings
    Visit Website
  • QuickApps
    Visit Website

About

This repository contains the research preview of LongLLaMA, a large language model capable of handling long contexts of 256k tokens or even more. LongLLaMA is built upon the foundation of OpenLLaMA and fine-tuned using the Focused Transformer (FoT) method. LongLLaMA code is built upon the foundation of Code Llama. We release a smaller 3B base variant (not instruction tuned) of the LongLLaMA model on a permissive license (Apache 2.0) and inference code supporting longer contexts on hugging face. Our model weights can serve as the drop-in replacement of LLaMA in existing implementations (for short context up to 2048 tokens). Additionally, we provide evaluation results and comparisons against the original OpenLLaMA models.

About

OpenEuroLLM is a collaborative initiative among Europe's leading AI companies and research institutions to develop a series of open-source foundation models for transparent AI in Europe. The project emphasizes transparency by openly sharing data, documentation, training, testing code, and evaluation metrics, fostering community involvement. It ensures compliance with EU regulations, aiming to provide performant large language models that align with European standards. A key focus is on linguistic and cultural diversity, extending multilingual capabilities to encompass all EU official languages and beyond. The initiative seeks to enhance access to foundational models ready for fine-tuning across various applications, expand evaluation results in multiple languages, and increase the availability of training datasets and benchmarks. Transparency is maintained throughout the training processes by sharing tools, methodologies, and intermediate results.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Users interested in a powerful Large Language Model solution

Audience

AI researchers and developers in need of a solution to advance their AI capabilities across diverse applications

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Not Supported

API

Offers API Not Supported

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version Supported
Free Trial Not Supported

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Company Information

LongLLaMA
github.com/CStanKonrad/long_llama

Company Information

OpenEuroLLM
openeurollm.eu/

Alternatives

Llama 2

Llama 2

Meta

Alternatives

Teuken 7B

Teuken 7B

OpenGPT-X
Llama

Llama

Meta
Olmo 3

Olmo 3

Ai2
Olmo 2

Olmo 2

Ai2
Inkling

Inkling

Thinking Machines Lab
Mistral Large 3

Mistral Large 3

Mistral AI

Categories

AI Coding Models Supported
AI Models Supported

Categories

AI Models Supported
Foundation Models Supported

Integrations

No info available.

Integrations

No info available.
Claim LongLLaMA and update features and information
Claim LongLLaMA and update features and information
Claim OpenEuroLLM and update features and information
Claim OpenEuroLLM and update features and information