Tuesday, October 27, 2026i10X News · Section desk7 stories
Studies
Efficiency & Training
Training methods, scaling, distillation, inference efficiency
FilterDeepSeek
Filtered: DeepSeek in Efficiency & Training · 2 storiesReset filter ×
-
Chunked KV Compression Creates Periodic Blind Spots Up to 40 Points Wide

DeepSeek-V4 family retrieval accuracy swings by as much as 40 pp depending on a token’s phase inside the compression window — gaps average scores hide.
By
Editor's picks
- Chunked KV Compression Creates Periodic Blind Spots Up to 40 Points Wide
- Diffusion-Augmented LLMs Deliver Up to 3× Lossless Speedups Over Autoregressive Decoding
- A Small RL Teacher Can Lift a Larger Student Past Itself via On-Policy Distillation
- On-Policy Distillation Isn’t the Magic — Learning Rate and KL Direction Are
- MiniMax Sparse Attention: 14× Prefill Speedup at 1M Context Without Quality Loss
More stories
· RSS