Section
Studies
AI and LLM research papers, explained: what each study shows, how solid the evidence is and what it means in practice.
FilterDeepSeek
-
LLM Reviewers Send 76% of Published Top-Journal Papers Back, Yet Miss Most Planted Flaws
Four LLMs reviewed 200 papers already published in journals like Nature and Cell: 75.6% of reviews demanded major revision or rejection, while planted flaws were caught 17% to 61% of the time.
By
-
Only One AI Agent Beats Researchers’ Own Code on Most FrontierCS 2 Tasks
FrontierCS 2 deletes a paper’s contribution from its repository and asks agents to beat the authors’ own code.…
-
Chunked KV Compression Creates Periodic Blind Spots Up to 40 Points Wide
DeepSeek-V4 family retrieval accuracy swings by as much as 40 pp depending on a token’s phase inside the…
-
DeepSeek-V4.1-Flash Shrinks Always-On KV Cache to 890 Bytes per Token
DeepSeek’s 552B MoE activates 16B params in decode but only 8B in prefill. CSA2 + FP4 KV cuts…
-
A 3B Model Hits 94.3 on AIME26 and 80.2 on LiveCodeBench
VibeThinker-3B from Weibo reaches frontier-band verifiable reasoning: 94.3 AIME26 (97.1 with claim-level TTS), 80.2 LiveCodeBench v6 Pass@1, 96.1%…
More stories
-
Turn Off Thinking Mode and Models Still Reason 99.9% of the Time
Thinking Inertia study: DeepSeek-V4-Flash keeps visible inference in 99.9% of open-ended answers with thinking disabled. Strict answer-only prompts raise Empty-Thinking Rate to ~40% but cut accuracy…
-
Coding Agents Can’t Build the Agent You Actually Want — Yet
AgentSWE’s 25 commission-style tasks: strongest builders average 19.1 on Creation and 31.6 on Editing. Optimization closes under 5% of the remaining gap; 58.1% of held-out Creation…
-
Scientific AI Agents Finish Only 21% of End-to-End Workflows — and Often Claim Success Anyway
FrontierChallenge: best configs pass 20.6% of 97 released science workflows. In electrochemistry, Avg. Score hits 94.9 with 0% full completion; 75.5% of failed Claude Code runs…
-
Giving AI Agents Incentives Nearly Doubles How Often They Deceive, Benchmark Finds
DecepEval tests 9 frontier models on 1,532 scenarios: inducements raise deception by 41.6% on average, with long-horizon tasks hitting 87% induced rates.
-
AI Resume Screeners Flipped Racial Bias Between Model Generations, Audit Finds
A paired-resume audit of 14 LLMs: GPT-3.5-turbo favored White-coded names by 2.12 points, while every model released in 2024 or later showed no gap or a…
Editor's picks
- Tampered ML: Even the Best AI Models Miss One in Five Planted Research Flaws
- Realistic MCP Faults Halve Agent Quality, and a Bigger Model Doesn’t Help
- Copilot Users Collaborate More, Not Less: Study of 12,000 Employees
- LLM Reviewers Send 76% of Published Top-Journal Papers Back, Yet Miss Most Planted Flaws