XNews

Tencent Releases Hy4 Open Weights: 770B MoE Multimodal Model with 1M Context

Tencent Releases Hy4 Open Weights: 770B MoE Multimodal Model with 1M Context

Tencent released the open weights for Hy4, a natively multimodal flagship Mixture-of-Experts model with 770B total parameters, 49B activated per token, and 1M context. The release includes a Hy4 System Card with a comprehensive safety evaluation report, plus GitHub, Hugging Face weights, GGUF, and license links. A live AMA with the Hy team is scheduled for Friday, 8–10 AM PT on r/LocalLLaMA.

Event version 1.

Key insights

Open weights released

Tencent released the open weights for Hy4, its natively multimodal flagship MoE model. The model has 770B total parameters with 49B activated per token and a 1M context window.

System Card included

The release includes the Hy4 System Card with a comprehensive safety evaluation report.

Multiple distribution channels

Hy4 is available via GitHub, Hugging Face weights, and GGUF formats, with a separate license link provided.

Live AMA scheduled

The Hy team will hold a live AMA this Friday from 8–10 AM PT on r/LocalLLaMA to answer questions about Hy models.

Source posts