Hy3Tencent
|
MPT-7BMosaicML
|
|||||
Related Products
|
||||||
About
Hy3 preview is Tencent Hy’s most intelligent model in the Hy series to date, built as a 295B-parameter Mixture-of-Experts model with 21B activated parameters, 3.8B MTP layer parameters, and support for up to a 256K token context window. As the first model trained on Tencent Hy’s rebuilt infrastructure, Hy3 preview is designed to improve real-world usability across complex reasoning, instruction following, context learning, coding, agent capabilities, and overall inference performance. It integrates both fast and slow thinking capabilities, allowing direct responses for simpler tasks and deeper reasoning for complex math, coding, and reasoning work. The model is built around well-rounded capabilities across long-context understanding, instruction following, tool use, and agent workflows, with evaluation focused not only on standard benchmarks but also on authentic business and development scenarios.
|
About
Introducing MPT-7B, the latest entry in our MosaicML Foundation Series. MPT-7B is a transformer trained from scratch on 1T tokens of text and code. It is open source, available for commercial use, and matches the quality of LLaMA-7B. MPT-7B was trained on the MosaicML platform in 9.5 days with zero human intervention at a cost of ~$200k.
Now you can train, finetune, and deploy your own private MPT models, either starting from one of our checkpoints or training from scratch. For inspiration, we are also releasing three finetuned models in addition to the base MPT-7B: MPT-7B-Instruct, MPT-7B-Chat, and MPT-7B-StoryWriter-65k+, the last of which uses a context length of 65k tokens!
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
AI labs and agent-framework developers who need a large reasoning model for coding, tool use, long-context tasks, and real-world agent workflows
|
Audience
AI and LLM developers and engineers
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
Free
Free Version
Free Trial
|
Pricing
Free
Open source
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationTencent
Founded: 1998
China
hy.tencent.com/research/hy3-preview
|
Company InformationMosaicML
Founded: 2021
United States
www.mosaicml.com/blog/mpt-7b
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
|
|
|