Tuesday, October 27, 2026i10X News · Section desk7 stories
Studies
Efficiency & Training
Training methods, scaling, distillation, inference efficiency
FilterMoonshot AI
Filtered: Moonshot AI in Efficiency & Training · 1 storyReset filter ×
-
Kimi K3: A 2.8T Open MoE With 2.5× Better Scaling Than K2
Moonshot’s Kimi K3 activates 104B of 2.8T params, adds native vision and 1M context. KDA, Attention Residuals and Stable LatentMoE deliver ~2.5× scaling efficiency over Kimi K2.
By
Editor's picks
- Chunked KV Compression Creates Periodic Blind Spots Up to 40 Points Wide
- Diffusion-Augmented LLMs Deliver Up to 3× Lossless Speedups Over Autoregressive Decoding
- A Small RL Teacher Can Lift a Larger Student Past Itself via On-Policy Distillation
- On-Policy Distillation Isn’t the Magic — Learning Rate and KL Direction Are
- MiniMax Sparse Attention: 14× Prefill Speedup at 1M Context Without Quality Loss
More stories
· RSS