Contra Labs, the research arm of the freelance platform Contra, released its Frontier Design Benchmark on 18 November: 33 website and app briefs, mostly adapted from paid client jobs, judged in blind pairs by professional designers. First place on the live leaderboard goes to a model nobody can use yet. “Gestalt”, a stealth entry whose developer Contra does not name, sits at 1,931 Elo with a 90% win rate, ahead of the human reference designs at 1,739 and 74%. According to Contra Labs, it is the first model rated above those human designs, which is why design teams should care even before it ships.
Quick Take
- The test: 27 briefs adapted from Contra jobs plus 6 real projects from startup partners, 35 designers, 4,311 blind votes.
- The ranking: Gestalt first, human designers second, then Claude Fable 5.2 (1,713) and Claude Opus 5.5 (1,691). Google’s best entry, Gemini 4 Carbon, is 12th.
- Our calculation: a 192-point Elo lead over humans implies Gestalt should win about three of four head-to-head picks. Contra’s own count, 20 of 28 against the human designs, fits that.
- Missing: GPT-6.2 Astra and Gemini 4 Neon, both released this week, are not on the board yet.
How the benchmark works
Contra rewrote 27 real website jobs from its marketplace for fictional clients and added six projects that startups had actually hired Contra designers for, with their own brand files. Models ran as agents in sandboxes through BenchFlow’s SDK, with OpenRouter as provider and, where possible, each lab’s own agent harness. For the human baseline, Contra paid designers to go through moodboards and feedback rounds before building their “golden” version.
Designers then compared two anonymous outputs for the same brief and picked the better one. Contra converts the votes into Elo ratings with a Bradley-Terry model. When it split the panel into two random halves, the two rankings agreed at a Spearman correlation of 0.95, a sign the ordering is not just noise.
The board moved within hours of launch
When Contra Labs announced the benchmark, humans were still on top:
Real client briefs, judged by real designers. 3,591 votes later, designers ranked #1.
— Contra Labs (@contralabs) November 18, 2026 · View on X
The Frontier Design Benchmark is live.
About twenty minutes later, a Contra team member posted the Gestalt preview:
Breaking🚨: There is a new model “Gestalt” that is beating everything, including the human golden designs 👀
— ben (@contraben) November 18, 2026 · View on X
The research post lists Gestalt at 1,928 Elo with 378 wins in 423 votes. The live board now shows 1,931 and 90% on 420 votes, so the figures are still being updated. Current standings for selected entries:
| Rank | Entry | Maker | Elo | Win rate |
|---|---|---|---|---|
| 1 | Gestalt (stealth) | Not disclosed | 1,931 | 90% |
| 2 | Human designers | Contra designers | 1,739 | 74% |
| 3 | Claude Fable 5.2 | Anthropic | 1,713 | 73% |
| 4 | Claude Opus 5.5 | Anthropic | 1,691 | 73% |
| 5 | GPT-6.1 Sol | OpenAI | 1,668 | 70% |
| 6 | Claude Sonnet 5.5 | Anthropic | 1,667 | 69% |
| 7 | Kimi K3.1 Pro | Moonshot AI | 1,663 | 71% |
| 8 | GPT-6 Astra | OpenAI | 1,638 | 66% |
| 9 | Qwen3.8 Max | Alibaba | 1,434 | 39% |
| 12 | Gemini 4 Carbon | 1,366 | 36% | |
| 15 | Grok 4.7 | xAI | 1,247 | 23% |
| 17 | DeepSeek V4 Pro | DeepSeek | 1,121 | 12% |
Two tiers, by our count
Below Gestalt and the humans, the board splits cleanly. Six models sit between 1,638 and 1,713 Elo: three from Anthropic, two from OpenAI and Moonshot’s open-weights Kimi K3.1 Pro. The next entry, Qwen3.8 Max, is 204 points lower at 1,434. That makes Kimi K3.1 Pro the only open-weights model in the top group, and puts both Gemini models, Grok 4.7 and DeepSeek V4 Pro in the lower one.
Two caveats apply. The newest releases have not been tested: GPT-6.2 Astra launched on 17 November and Gemini 4 Neon on 19 November, so the weak Google showing may not last. And Contra is not a neutral referee: it says it already works with frontier labs to improve their models’ design output, and it offers evaluation data to labs as a service. Gestalt itself has no named developer, no API and no price, so nobody outside Contra can check the result.
Taste beats the checklist, and what builders can use
The most useful finding for teams shipping AI-built sites is a disagreement. Contra also grades every page on a rubric of concrete design rules. There, the human designs score 73.6 and rank only sixth of 16, behind the Claude models (79.3 to 83.8) and both GPT entries. Designers still preferred the human pages in 74% of votes. The rubric catches errors like low-contrast buttons, while the voters reward overall judgment.
Contra’s “Slop Detector” also lists patterns that make a page look machine-made. Worth checking before you publish a generated landing page:
- A small capitalized label above every heading that repeats it. Contra found this on at least half the sections of 93% of AI pages in its training set, against 11% of human pages.
- One italic word in the main headline, and section numbers like 01, 02, 03.
- Every block in its own card, a habit of Gemini 4 Argon (97% of its pages) and Gemini 4 Carbon (94%).
- Lab fingerprints: Claude models favor a horizontal arrow on links, GPT models a diagonal one.
What is still open
- Who built Gestalt, and whether and when it becomes available.
- Whether GPT-6.2 Astra, Gemini 4 Neon and other new models get added, and how the gap to humans changes.
- Independent replication of the votes by anyone outside Contra and BenchFlow.






