Hy4

Hy4

Tencent
+
+

Related Products

  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    999 Ratings
    Visit Website
  • Checksum.ai
    1 Rating
    Visit Website
  • QuantaStor
    6 Ratings
    Visit Website
  • Google AI Studio
    30 Ratings
    Visit Website
  • Lockbox LIMS
    72 Ratings
    Visit Website
  • Bitdefender Ultimate Small Business Security
    5 Ratings
    Visit Website
  • AddSearch
    140 Ratings
    Visit Website
  • Pipefy
    592 Ratings
    Visit Website
  • Visual Planning
    117 Ratings
    Visit Website

About

Hy4 preview is a new-generation open source Mixture-of-Experts flagship model built for real-world productivity tasks across software engineering, office work, game development, and scientific research. The model contains 770B total parameters with 49B activated per token and supports a 1M-token context window, giving it the capacity to work through large codebases, extensive document collections, and long multi-step tasks. Its 78-layer architecture combines Gated DeepSeek Sparse Attention with IndexCache for cross-layer sparse index reuse and identity Hyper-Connections to expand information flow between layers. A native Multi-Token Prediction layer is included for speculative decoding. Hy4 preview is designed to understand, plan, debug, and verify long-horizon engineering tasks, with additional gains in front-end visual quality and interaction design.

About

This repository contains the research preview of LongLLaMA, a large language model capable of handling long contexts of 256k tokens or even more. LongLLaMA is built upon the foundation of OpenLLaMA and fine-tuned using the Focused Transformer (FoT) method. LongLLaMA code is built upon the foundation of Code Llama. We release a smaller 3B base variant (not instruction tuned) of the LongLLaMA model on a permissive license (Apache 2.0) and inference code supporting longer contexts on hugging face. Our model weights can serve as the drop-in replacement of LLaMA in existing implementations (for short context up to 2048 tokens). Additionally, we provide evaluation results and comparisons against the original OpenLLaMA models.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Developers, researchers, and technical professionals seeking an AI model for coding, document work, game development, scientific reasoning, and complex productivity tasks

Audience

Users interested in a powerful Large Language Model solution

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Tencent
Founded: 1998
China
hy.tencent.ai/research/hy4-preview

Company Information

LongLLaMA
github.com/CStanKonrad/long_llama

Alternatives

Alternatives

Llama 2

Llama 2

Meta
GPT-5.6 Sol

GPT-5.6 Sol

OpenAI
Olmo 3

Olmo 3

Ai2
Inkling

Inkling

Thinking Machines Lab

Categories

Categories

Integrations

Tencent Hy

Integrations

Tencent Hy
Claim Hy4 and update features and information
Claim Hy4 and update features and information
Claim LongLLaMA and update features and information
Claim LongLLaMA and update features and information