Hy4Tencent
|
||||||
| Hy4 | LongLLaMA | |||||
|---|---|---|---|---|---|---|
Related Products
|
||||||
Hy4:
About
Hy4 preview is a new-generation open source Mixture-of-Experts flagship model built for real-world productivity tasks across software engineering, office work, game development, and scientific research. The model contains 770B total parameters with 49B activated per token and supports a 1M-token context window, giving it the capacity to work through large codebases, extensive document collections, and long multi-step tasks. Its 78-layer architecture combines Gated DeepSeek Sparse Attention with IndexCache for cross-layer sparse index reuse and identity Hyper-Connections to expand information flow between layers. A native Multi-Token Prediction layer is included for speculative decoding. Hy4 preview is designed to understand, plan, debug, and verify long-horizon engineering tasks, with additional gains in front-end visual quality and interaction design.
|
LongLLaMA:
About
This repository contains the research preview of LongLLaMA, a large language model capable of handling long contexts of 256k tokens or even more. LongLLaMA is built upon the foundation of OpenLLaMA and fine-tuned using the Focused Transformer (FoT) method. LongLLaMA code is built upon the foundation of Code Llama. We release a smaller 3B base variant (not instruction tuned) of the LongLLaMA model on a permissive license (Apache 2.0) and inference code supporting longer contexts on hugging face. Our model weights can serve as the drop-in replacement of LLaMA in existing implementations (for short context up to 2048 tokens). Additionally, we provide evaluation results and comparisons against the original OpenLLaMA models.
|
|||||
Hy4:
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
LongLLaMA:
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Hy4:
Audience
Developers, researchers, and technical professionals seeking an AI model for coding, document work, game development, scientific reasoning, and complex productivity tasks
|
LongLLaMA:
Audience
Users interested in a powerful Large Language Model solution
|
|||||
Hy4:
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
LongLLaMA:
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
|||||
Hy4:
API
Offers API
Supported
|
LongLLaMA:
API
Offers API
Not Supported
|
|||||
Hy4:
Screenshots and Videos |
LongLLaMA:
Screenshots and Videos |
|||||
Hy4:
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
LongLLaMA:
Pricing
Free
Free Version
Supported
Free Trial
Not Supported
|
|||||
Hy4:
Reviews/
|
LongLLaMA:
Reviews/
|
|||||
Hy4:
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
LongLLaMA:
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Hy4:
Company InformationTencent
Founded: 1998
China
hy.tencent.ai/research/hy4-preview
|
LongLLaMA:
Company InformationLongLLaMA
github.com/CStanKonrad/long_llama
|
|||||
Hy4:
Alternatives |
LongLLaMA:
Alternatives |
|||||
|
Hy4:
|
LongLLaMA:
|
|||||
|
Hy4:
|
LongLLaMA:
|
|||||
|
Hy4:
|
LongLLaMA:
|
|||||
|
Hy4:
|
LongLLaMA:
|
|||||
Hy4:
Categories |
LongLLaMA:
Categories |
|||||
| Hy4: |
LongLLaMA:
Integrations
Tencent Hy
Not Supported
|
|||||
|
Hy4:
|
LongLLaMA:
|