Tencent Hy4 Flash Open Weights: 220B Model With 12B Active Parameters Lands on Hugging Face

Tencent released Hy4 flash, an FP8 version and the base model as open weights on Hugging Face, ModelScope and GitCode. The model card confirms 220B total parameters, about 12B active, a 1M-token context and a custom Tencent Hy License.

Christopher Ort
By Christopher Ort · 3 min read
Share
Server racks in a data center aisle with a laptop on a cart.
Image: AI-generated, i10X
On this page
  1. Quick Take
  2. In plain English
  3. What happened
  4. How it works
  5. Why it matters
  6. What's still open
  7. Sources
  8. i10x Perspective

Tencent has published the weights of Hy4 flash, its low-cost multimodal model, on Hugging Face, ModelScope and GitCode. The release includes the instruct model, an FP8 version and the pre-trained base model, and the model card now confirms what the launch two days earlier left open: about 220 billion total parameters, roughly 12 billion active per token, a one-million-token context and a custom Tencent licence.

i10X Quick Take

Quick Take

  1. Released: Hy4 flash, Hy4 flash-FP8 and Hy4 flash-base as open-weight models on Hugging Face, ModelScope and GitCode.
  2. Size: 220B total parameters including 63.5B “Engram” n-gram embedding parameters; 11.3B active text parameters per token plus 0.43B for vision.
  3. Context: 1,048,576 tokens; accepts text and images, outputs text.
  4. Cost: on Tencent’s internal WorkIndex benchmark, average cost per task is 1/13 of Hy4 preview and 1/20 of Hy4, with a score of 42.1 versus 39.7 for Hy4 preview.
  5. Licence: the Tencent Hy License, which is not a standard open-source licence.

In plain English

Two days ago Tencent launched Hy4 flash as a cheap model you could only use through its cloud. Now anyone can download the model files and run it on their own servers. It is a large model, but only a small part of it works on each word, which keeps it fast and cheap. You still need serious hardware, and the licence has its own rules.

What happened

Tencent’s Hy team added the three repositories under tencent/Hy4-flash with a detailed model card. The independent site ModelFit reported that the weights appeared on Hugging Face on 17 November and are not gated, with the BF16 files totalling about 441 GB and the FP8 files about 287 GB. Tencent provides ready-made vLLM and SGLang container images, a built-in speculative decoding drafter called DFly2 and a finetuning guide.

When i10x covered the TokenHub API launch on 16 November, Tencent’s documents gave no parameter count, licence or date for an open-weight release. The model card now fills those gaps.

How it works

  • Mixture of experts: a 42-layer backbone with one dense layer and 41 MoE layers; each token activates 16 of 512 routed experts plus one shared expert.
  • Hybrid attention: sparse attention and sliding-window attention are interleaved at a 1:3 ratio, which Tencent says cuts the KV cache to 1/24 of Hy3’s and 1/6 of Hy4’s.
  • Engram: learned bigram and trigram embeddings retrieved through hash lookups augment the backbone.
  • Speed: megakernels, 4-bit quantization and DFly2 push decoding past 150 tokens per second, according to Tencent.
  • User test: in a blind evaluation with 85 internal users across 259 tasks, Hy4 flash scored 2.79 out of 4 for satisfaction against 2.81 for Claude Haiku 5.5, at RMB 0.26 per task.

Why it matters

For developers and companies, Hy4 flash adds a cost-focused multimodal option to the growing pool of large Chinese open-weight models that can be self-hosted for agents and office work.

For inference providers, the licence matters. ModelFit notes that the Tencent Hy License adds commercial terms and requires a separate written licence for model-as-a-service businesses.

For hobbyists, the model is too big for most single machines; an official 4-bit GGUF is about 157 GiB, and llama.cpp support was still an open pull request.

What’s still open

  • Independent benchmark results on the public agent tests Tencent cites.
  • Transformers support, which Tencent says will be merged into the main branch soon.
  • How the licence terms affect hosting by third-party API providers.

Sources

  • Tencent Hy team, Hy4 flash model card, Hugging Face, accessed 18 November 2026
  • ModelFit, “Tencent Hy4 Flash Weights Are Out: What Hardware Runs It?,” updated 18 November 2026

i10x Perspective

Tencent followed a familiar pattern: launch on its own cloud, then open the weights days later to win developers. With Moonshot’s Kimi K3.1 Pro weights and others, cheap Chinese open models keep raising the floor for what self-hosted AI can do. See our earlier report on the Hy4 flash TokenHub launch and more in the Models section.

Christopher Ort

Christopher Ort

Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU). He is the author of “The Style Penalty”, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.

ModelsNews

Editor's picks

  1. GAO Report: ChatGPT, Claude, Gemini and Grok Produced Viable Attack Plans After Safeguards Were Bypassed
  2. ResolveAI SRE-1: A 27B Model Trained to Find the Root Cause of Production Incidents
  3. Reson8 Rumble-2-Flash: Open-Weight 0.5B Speech Recognition Model Covers 40+ Languages
  4. Pika Enact Lets Creators Direct AI Video Actors and Cameras in Real Time
  5. Google Stitch Loop: An Always-On Product Agent That Fixes Security, Speed and Accessibility via Pull Requests