Tuesday, October 27, 2026i10X News · Section desk9 stories
Studies
Benchmarks & Evals
New benchmarks, evaluation methods and leaderboard results
FilterxAI
Filtered: xAI in Benchmarks & Evals · 1 storyReset filter ×
-
Scientific AI Agents Finish Only 21% of End-to-End Workflows — and Often Claim Success Anyway
FrontierChallenge: best configs pass 20.6% of 97 released science workflows. In electrochemistry, Avg. Score hits 94.9 with 0% full completion; 75.5% of failed Claude Code runs still claim success.
By
Editor's picks
- Tampered ML: Even the Best AI Models Miss One in Five Planted Research Flaws
- Only One AI Agent Beats Researchers’ Own Code on Most FrontierCS 2 Tasks
- Hybrid Computer-Use Agents Top Out at 41% When GUI and CLI Must Work Together
- Scientific AI Agents Finish Only 21% of End-to-End Workflows — and Often Claim Success Anyway
- AI Agents Guess Wrong at Critical Forks 40% of the Time, Taste-Bench Shows
More stories
· RSS