+
+

Related Products

  • Gemini Enterprise Agent Platform
    984 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Google AI Studio
    30 Ratings
    Visit Website
  • Checksum.ai
    1 Rating
    Visit Website
  • Iris Identity Protection
    3 Ratings
    Visit Website
  • DataHub
    10 Ratings
    Visit Website
  • SBS Asset Finance
    3 Ratings
    Visit Website
  • Enterprise Bot
    23 Ratings
    Visit Website
  • QuickApps
    Visit Website
  • Iru
    1,351 Ratings
    Visit Website

About

This repository contains the research preview of LongLLaMA, a large language model capable of handling long contexts of 256k tokens or even more. LongLLaMA is built upon the foundation of OpenLLaMA and fine-tuned using the Focused Transformer (FoT) method. LongLLaMA code is built upon the foundation of Code Llama. We release a smaller 3B base variant (not instruction tuned) of the LongLLaMA model on a permissive license (Apache 2.0) and inference code supporting longer contexts on hugging face. Our model weights can serve as the drop-in replacement of LLaMA in existing implementations (for short context up to 2048 tokens). Additionally, we provide evaluation results and comparisons against the original OpenLLaMA models.

About

Nemotron-3 Super is part of NVIDIA’s Nemotron 3 family of open models designed to enable advanced agentic AI systems that can reason, plan, and execute multi-step workflows across complex environments. The model introduces a hybrid Mamba-Transformer Mixture-of-Experts architecture that combines the efficiency of state-space Mamba layers with the contextual understanding of transformer attention, allowing it to process long sequences and complex reasoning tasks with high accuracy and throughput. This architecture activates only a subset of model parameters for each token, improving computational efficiency while maintaining strong reasoning capabilities and enabling scalable inference for large workloads. Nemotron-3 Super contains roughly 120 billion parameters with around 12 billion active during inference, accelerating multi-step reasoning and collaborative agent interactions across large contexts.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Users interested in a powerful Large Language Model solution

Audience

AI engineers and researchers building scalable multi-agent systems that require efficient long-context reasoning and advanced AI agent workflows

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

LongLLaMA
github.com/CStanKonrad/long_llama

Company Information

NVIDIA
Founded: 1993
United States
nvidia.com

Alternatives

Llama 2

Llama 2

Meta

Alternatives

Claude Sonnet 5

Claude Sonnet 5

Anthropic
DeepSeek-V4

DeepSeek-V4

DeepSeek
Inkling

Inkling

Thinking Machines Lab
Kimi K2

Kimi K2

Moonshot AI
Nemotron 3

Nemotron 3

NVIDIA

Categories

Categories

Integrations

Nemotron 3
Perplexity Computer
Perplexity Pro
Together AI

Integrations

Nemotron 3
Perplexity Computer
Perplexity Pro
Together AI
Claim LongLLaMA and update features and information
Claim LongLLaMA and update features and information
Claim Nemotron 3 Super and update features and information
Claim Nemotron 3 Super and update features and information