Hy4

Hy4

Tencent
Hy4 LongLLaMA

Related Products

  • LM-Kit.NET
    4.8 out of 5 stars 29 Ratings
    Visit Website for LM-Kit.NET
  • Gemini platform
    4.3 out of 5 stars 1,178 Ratings
    Visit Website for Gemini platform
  • FinOpsly
    4.7 out of 5 stars 3 Ratings
    Visit Website for FinOpsly
  • QuantaStor
    4.8 out of 5 stars 6 Ratings
    Visit Website for QuantaStor
  • Google AI Studio
    4.8 out of 5 stars 42 Ratings
    Visit Website for Google AI Studio
  • Lockbox LIMS
    4.8 out of 5 stars 72 Ratings
    Visit Website for Lockbox LIMS
  • Bitdefender Ultimate Small Business Security
    5.0 out of 5 stars 5 Ratings
    Visit Website for Bitdefender Ultimate Small Business Security
  • AddSearch
    4.6 out of 5 stars 145 Ratings
    Visit Website for AddSearch
  • Pipefy
    4.6 out of 5 stars 594 Ratings
    Visit Website for Pipefy
  • Visual Planning
    4.5 out of 5 stars 120 Ratings
    Visit Website for Visual Planning
Hy4:

About

Hy4 preview is a new-generation open source Mixture-of-Experts flagship model built for real-world productivity tasks across software engineering, office work, game development, and scientific research. The model contains 770B total parameters with 49B activated per token and supports a 1M-token context window, giving it the capacity to work through large codebases, extensive document collections, and long multi-step tasks. Its 78-layer architecture combines Gated DeepSeek Sparse Attention with IndexCache for cross-layer sparse index reuse and identity Hyper-Connections to expand information flow between layers. A native Multi-Token Prediction layer is included for speculative decoding. Hy4 preview is designed to understand, plan, debug, and verify long-horizon engineering tasks, with additional gains in front-end visual quality and interaction design.
LongLLaMA:

About

This repository contains the research preview of LongLLaMA, a large language model capable of handling long contexts of 256k tokens or even more. LongLLaMA is built upon the foundation of OpenLLaMA and fine-tuned using the Focused Transformer (FoT) method. LongLLaMA code is built upon the foundation of Code Llama. We release a smaller 3B base variant (not instruction tuned) of the LongLLaMA model on a permissive license (Apache 2.0) and inference code supporting longer contexts on hugging face. Our model weights can serve as the drop-in replacement of LLaMA in existing implementations (for short context up to 2048 tokens). Additionally, we provide evaluation results and comparisons against the original OpenLLaMA models.
Hy4:

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported
LongLLaMA:

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported
Hy4:

Audience

Developers, researchers, and technical professionals seeking an AI model for coding, document work, game development, scientific reasoning, and complex productivity tasks
LongLLaMA:

Audience

Users interested in a powerful Large Language Model solution
Hy4:

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported
LongLLaMA:

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported
Hy4:

API

Offers API Supported
LongLLaMA:

API

Offers API Not Supported
Hy4:

Screenshots and Videos

LongLLaMA:

Screenshots and Videos

Hy4:

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported
LongLLaMA:

Pricing

Free
Free Version Supported
Free Trial Not Supported
Hy4:

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software
LongLLaMA:

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software
Hy4:

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported
LongLLaMA:

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported
Hy4:

Company Information

Tencent
Founded: 1998
China
hy.tencent.ai/research/hy4-preview
LongLLaMA:

Company Information

LongLLaMA
github.com/CStanKonrad/long_llama
Hy4:

Alternatives

Gemini 4 Hydrogen

Gemini 4 Hydrogen

Google
5.0 out of 5 stars
LongLLaMA:

Alternatives

Llama 2

Llama 2

Meta
Hy4:
Claude Fable 5.2

Claude Fable 5.2

Anthropic
5.0 out of 5 stars
LongLLaMA:
Muse Spark Open

Muse Spark Open

Meta
5.0 out of 5 stars
Hy4:
LongLLaMA:
Hy4:
LongLLaMA:
Hy4:
LongLLaMA:
Inkling

Inkling

Thinking Machines Lab
Hy4:

Categories

AI Coding Models Supported
AI Models Supported
Foundation Models Supported
LongLLaMA:

Categories

AI Coding Models Supported
AI Models Supported
Hy4:

Integrations

Tencent Hy Supported
LongLLaMA:

Integrations

Tencent Hy Not Supported
Hy4:
Claim Hy4 and update features and information
Claim Hy4 and update features and information
LongLLaMA:
Claim LongLLaMA and update features and information
Claim LongLLaMA and update features and information