Reason Coding Harness Promises 20x Lower Costs. Its Own Benchmarks Show 22%

YC startup Reason Machines went viral with a coding harness promising frontier results at up to 20x lower cost. Its published benchmark on GPT-6 Astra shows a smaller but real edge: 65.1 versus 62.5 for Codex at 22% lower cost per solved task, thanks to cache-friendly prompts and parallel tool calls.

Christopher Ort
By Christopher Ort · 8 min read
Share
A programmer works late at two monitors with a stack of invoices and a calculator beside the keyboard.
Image: AI-generated, i10X
On this page
  1. Quick Take
  2. In plain English
  3. What happened
  4. The numbers, side by side
  5. How it works
  6. Pros and cons
  7. What X is saying
  8. Critical analysis
  9. What's still open
  10. About the analysis
  11. i10x Perspective

Every team running coding agents knows the feeling: the agent fixed the bug, and the invoice fixed your mood. Reason Machines, a Y Combinator startup, is selling the cure. On November 13, 2026, cofounder Adi Singh introduced Reason on X as “the world’s most cost-efficient harness,” promising “frontier coding performance at up to 20x lower cost.” The post took off. The company’s own published benchmarks, however, tell a more modest and more interesting story: a 22% lower cost per solved task than OpenAI’s Codex on the same model.

i10X Quick Take

Quick Take

  1. What launched: Reason, a coding agent and “harness” (the software around an AI model that manages prompts, tools and context) from Reason Machines, promoted on X on November 13, 2026.
  2. The headline claim: “Up to 20x lower cost” and better results than top harnesses on Terminal-Bench and DeepSWE, per the launch post.
  3. The published numbers: On GPT-6 Astra, Reason scored 65.1 against Codex’s 62.5 on the Coding Agent Index v1.5 at 22% lower cost per solved task, in the company’s own reproduction, which Artificial Analysis has not reviewed or endorsed.
  4. How it saves money: A small, stable prompt that maximizes prompt caching, and a “codemode” tool that runs several tool calls in one step.
  5. Price: Pro costs $50 per month and Max $200 per month, with usage billed in credits; users can also connect their own ChatGPT, Claude, Copilot or Grok subscriptions and API keys.

In plain English

AI coding assistants charge for every chunk of text they read and write, and a lot of that text is the same instructions sent over and over. Reason is a new tool that wraps around existing AI models and tries to reuse that repeated text so it is billed at a discount. The company says this makes coding work much cheaper. Its own detailed tests show savings of roughly a fifth compared with OpenAI’s tool, which is useful but far from the “20 times cheaper” in its marketing post.

What happened

Reason Machines was founded by Adi and Sven, who studied EECS at UC Berkeley and, in their words, “dropped out to build what a self-driving company runs on,” according to the company’s launch blog post dated November 9. Singh’s X bio lists the company as part of YC F26. The blog post claims “20,000 users, 14,000 X followers, and 3M+ impressions” in the four weeks since launch, and says the company is raising its seed round.

The November 13 video post pushed the product into the trending list. In it, Reason patches a security bug, merges the fix and repairs a customer’s broken export straight from Slack. TestingCatalog summarized that Reason “solved more tasks than Codex on the same model while spending 22% less” and that users can give it standing jobs, such as reviewing every new pull request.

The numbers, side by side

Here is where the claims diverge. The launch post on X says “up to 20x.” The November 9 blog post says “up to 30% lower cost per task than Codex, Cursor or Devin.” The detailed Reason 1.1 benchmark write-up from October 10 reports:

SourceDateClaim
Launch post on X (Adi Singh)Nov 13, 2026“Up to 20x lower cost”; outperforms top harnesses on Terminal-Bench and DeepSWE
Launch blog postNov 9, 2026Up to 30% lower cost per task than Codex, Cursor or Devin
Reason 1.1 write-up (GPT-6 Astra)Oct 10, 2026Coding Agent Index v1.5: Reason 65.1, Codex 62.5, Pi 61.4
Reason 1.1 write-up (cost)Oct 10, 2026Cost per solved task 22% below Codex and 10% below Pi (own reproduction, not endorsed by Artificial Analysis)

The 1.1 write-up also says Reason “costs 15–23% less per attempt than Codex on every benchmark” and uses 23% fewer input tokens per attempt (1.92 million against 2.48 million) and 15% fewer output tokens on GPT-6 Astra. Crucially, all results are on Artificial Analysis’s Coding Agent Index v1.5 (DeepSWE v1.1, Terminal-Bench 4.0 and SWE-Atlas QnA). Artificial Analysis moved to version 2.0 on October 22, so the figures are not directly comparable with its current leaderboard. In the materials i10x reviewed, Reason did not publish a same-model comparison showing a 20x saving. A gap that large likely depends on comparing a cheap model inside Reason with an expensive frontier setup, but the company has not said so explicitly.

How it works

The core idea fits in one sentence from the company: “The model sets the pass rate; the harness sets the bill.” Reason says the same model can cost up to five times more in one harness than in another. Two design choices drive its savings:

  • Cache-friendly prompts: “The prompt and tools never change between turns and each request only appends to the last, so every turn is fully cache-eligible up to its new content.” As AI researcher Rohan Paul explained on X, providers bill repeated prompt prefixes at a steep discount, which compounds over long agent sessions.
  • Codemode: A tool that runs JavaScript calling the other tools, so “a search, five file reads and a test run can take one model call.” Fewer round trips mean fewer tokens.

Everything else (subagents, cloud computers, preview URLs, pull requests with screenshots) sits behind “deferred tools” the model finds on demand, keeping the base prompt small. Reason also publishes its benchmark runner on GitHub, so anyone can reproduce a run with the Harbor evaluation framework:

The repository’s quick check, as a script we call run-deepswe.sh:

run-deepswe.sh · Bash
uv tool install "harbor[e2b,modal]==0.22.0" --with "reason-machines-harbor>=0.3.44"
export REASON_API_KEY=<YOUR-REASON-KEY>
 
# One DeepSWE task on local Docker, to check your setup.
harbor run --dataset datacurve/deep-swe-1-1 --n-tasks 1 \
   --agent reasonmachines_harbor:ReasonAgent \
   --model openai/gpt-6-luna \
   --ak reasoning_effort=xhigh \
   --allow-agent-host api.reasonmachines.com \
   --allow-agent-host relay.reasonmachines.com

Sessions run from a web app, CLI, macOS or Linux desktop app, Slack or an HTTP API, on cloud Linux, a cloud Mac, the user’s own Mac or an SSH box. Users can bring API keys, open-weight models and subscriptions from Grok, Copilot or Kimi with automatic failover, according to the launch post.

Pros and cons

For users and solo developers

  • Pro: If the caching savings hold, a flat $50 per month with bring-your-own subscriptions can stretch existing AI plans further.
  • Con: Another subscription on top of the ones you already pay for, and savings depend heavily on which model you plug in.

For developers and engineering teams

  • Pro: Reproducible benchmark code, Slack-native standing jobs (like reviewing every pull request) and support for many models instead of a single vendor.
  • Con: The headline numbers are self-reported, and the benchmark version they use has already been replaced by Artificial Analysis.

For companies

  • Pro: Agent spend is becoming a real budget line. Even a 20% to 30% cut on large agent workloads adds up.
  • Con: A seed-stage vendor in the middle of code, credentials and cloud machines is a security and continuity risk that procurement teams will want to examine carefully.

What X is saying

The launch post itself:

TestingCatalog focused on the measured numbers:

Rohan Paul explained the caching trick:

The launch post asked readers to comment “Reason” for early access and free credits, a format that inflates reply counts and says little about real-world use. i10x did not find a substantive Grok assessment of Reason on X; Grok’s replies only restated the launch claims.

Critical analysis

Reason is tackling a real problem. Agent sessions are long, and providers discount cached tokens heavily, so a harness that keeps its prompt stable can save meaningful money. The design choices are sound and, unusually for a startup, documented with reproducible code.

The marketing is another matter. “Up to 20x” and “22% on the same model” are not the same claim, and only the second is backed by a published, same-model comparison. Readers should also note that the comparison is Reason’s own reproduction of a third-party benchmark, not an official Artificial Analysis result, and that the frontier labs keep tuning their own harnesses (OpenAI’s Codex, Anthropic’s Claude Code) for caching too. A 22% edge today can shrink with one vendor update.

What’s still open

  • Which comparison produces the “up to 20x” figure. Reason has not published it in the materials i10x reviewed.
  • Independent results on Artificial Analysis’s current Coding Agent Index v2.0.
  • How Reason secures customer code and connected subscription credentials across cloud machines.
  • Funding: the founders say they are raising a seed round; no amount or investors have been announced.

About the analysis

Researched and written with AI assistance under the editorial responsibility of the i10X News team. The title image is an AI-generated image. Read our AI Use Policy. Spotted an error? Request a correction.

This independent i10x analysis is based on Reason Machines’ launch post, its Reason 1.1 benchmark write-up, its benchmark repository and product comparison page, and public posts on X. i10x did not run Reason or reproduce the benchmarks.

i10x Perspective

The most useful idea in this launch is not the 20x headline but the sentence “the harness sets the bill.” As models converge in quality, the money moves to the layer that decides how many tokens a task burns. That is good news for buyers, who now have a lever beyond switching models. It is also a warning: a harness that only wins on caching discounts lives at the mercy of provider pricing. Reason’s open benchmark code is the right move. Now it needs an independent number to match the marketing.

Christopher Ort

Christopher Ort

Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU). He is the author of “The Style Penalty”, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.

Editor's picks

  1. Microsoft MDASH AI scanner drives 33 Linux kernel CVEs in three months
  2. CVE-2026-94407: IBM ContextForge MCP Gateway ReDoS flaw lets authenticated users trigger denial of service
  3. Baidu Pledges Apache 2.0 for ERNIE 5.5 Flash Preview Weights
  4. Scotland AI Data Centers Face Mounting Protests Over Energy Demands
  5. OpenAI Launches ChatGPT Wallet for Agent Purchases