{"id":6961,"date":"2026-11-06T08:50:13","date_gmt":"2026-11-06T08:50:13","guid":{"rendered":"https:\/\/i10xnews.kinsta.cloud\/?p=6961"},"modified":"2026-11-06T08:50:13","modified_gmt":"2026-11-06T08:50:13","slug":"llm-api-relays-answers-tools-billing-study","status":"publish","type":"post","link":"https:\/\/i10x.ai\/news\/llm-api-relays-answers-tools-billing-study","title":{"rendered":"LLM API Relays Often Mismatch Official Answers, Tools and Bills"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">\u26a1 Quick Take<\/h2>\n\n\n<ul class=\"wp-block-list\"><li><strong>The finding:<\/strong> Across 20 third-party LLM API relays advertising GPT-6 Astra and Claude Opus 5, first-round accuracy checks flagged 7 of 10 low-price services and 2 of 10 same- or higher-price ones for behavioral differences versus the official APIs.<\/li><li><strong>The billing risk:<\/strong> For identical requests, five relays reported 4,200 to about 60,000 more input tokens than OpenAI or Anthropic. Where balances were available, charges tracked those reported counts\u2014including unexplained surplus at one service.<\/li><li><strong>What else broke:<\/strong> No prompt injection showed up in 3,332 screened code and setup responses, yet four relays still returned tool calls after clients set <code>tool_choice: none<\/code>.<\/li><\/ul>\n\n\n<p class=\"wp-block-paragraph\">Third-party API relays promise cheaper or more convenient access to frontier models. You send a request for GPT or Claude; the relay forwards it and bills you. A new measurement study from Queen&#8217;s University, Kingston\u2014&#8221;What the Middleman Delivers: Answer Behavior, Tool Permissions, and Billed Usage in LLM API Relays&#8221;\u2014asks whether that middle hop preserves answer quality, tool permissions and honest usage reporting. The authors anonymize every service as R01\u2013R20 and compare them against batch-matched official <a href=\"\/news\/company\/open-ai\">OpenAI<\/a> and <a href=\"\/news\/company\/anthropic\">Anthropic<\/a> calls.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udd2c What the study shows<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The team measured three client-visible properties on public APIs: answer accuracy on a fixed knowledge bank, returned content and tool permissions, and reported input tokens versus official references (plus balance changes where available).<\/p>\n\n\n<ul class=\"wp-block-list\"><li><strong>Accuracy flags cluster on the cheap tier\u2014but not significantly at 0.05:<\/strong> In the primary first-round analysis, 7\/10 low-price relays and 2\/10 same- or higher-price relays had at least one flagged cell (two-sided Fisher p = 0.0698, reported as 0.07). A post-hoc &#8220;all four specifications&#8221; tally reaches 7\/10 versus 1\/10 (p = 0.02), but the authors treat that as non-primary.<\/li><li><strong>Some gaps are large:<\/strong> Relay R01&#8217;s Claude Opus 5 hit rate was 0.704 versus 0.992 officially (risk difference RD = 0.288). Pilot\/extension cells for R20 Opus reached 0.409 versus 1.000 (RD = 0.591) and R11 Opus RD = 0.574. Several Astra cells were also Confirmed or Suspected.<\/li><li><strong>Flags are not forever:<\/strong> Retesting 35 pairs 11\u201318 days later, seven cells gained or lost a flag under the original rules (six under matched correction families). Six services stayed flagged in both rounds (R01, R08, R10, R11, R17, R20).<\/li><li><strong>Tool permissions leaked:<\/strong> Across 3,332 screened non-adversarial responses, no injection was confirmed. Still, in round 1 four relays returned tool calls despite <code>tool_choice: none<\/code> (counts: R04 = 1, R11 = 24, R10 = 1, R17 = 4); R08 returned two <code>web_search<\/code> calls with no tools supplied. Round 2 showed none of those tool-call leaks.<\/li><li><strong>Token reports can inflate the bill:<\/strong> Five relays reported 4,200\u201360,000 extra input tokens versus the official API on identical requests. On one Astra item, R01 and R20 reported 4,416 input tokens (4,224 cached) where the official API reported 36. R10 Opus showed a median surplus near 59,500 tokens. For the six services with readable balances, deductions matched reported usage at listed prices; R11 sits in both the balance group and the &gt;4,000-token surplus group, so its surplus entered the bill.<\/li><\/ul>\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1344\" height=\"768\" src=\"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/11\/chart-relay-flags-by-price.webp\" alt=\"Grouped bar chart comparing flagged vs not-flagged LLM API relays in low-price (7 flagged, 3 not) and same-or-higher-price (2 flagged, 8 not) tiers.\" class=\"wp-image-6960\" srcset=\"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/chart-relay-flags-by-price.webp 1344w, https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/chart-relay-flags-by-price-300x171.webp 300w, https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/chart-relay-flags-by-price-1024x585.webp 1024w, https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/chart-relay-flags-by-price-768x439.webp 768w\" sizes=\"auto, (max-width: 1344px) 100vw, 1344px\" \/><figcaption class=\"wp-element-caption\">i10X chart based on data from Wu et al. (2026), arXiv:2611.07650, \u00a7V-B primary price-tier analysis.<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-table\"><table><thead><tr><th>Check<\/th><th>Key result<\/th><th>Caveat<\/th><\/tr><\/thead><tbody><tr><td>Accuracy vs official<\/td><td>7\/10 low-price and 2\/10 same\/higher-price relays flagged<\/td><td>Primary Fisher p = 0.07; not causal proof of substitution<\/td><\/tr><tr><td>Tool permissions<\/td><td>4 relays returned tool calls despite tool_choice: none (round 1)<\/td><td>Calls not executed; cause (relay vs upstream) unknown<\/td><\/tr><tr><td>Billed input tokens<\/td><td>5 relays: +4.2k to ~60k tokens vs official<\/td><td>Surplus \u2260 proven hidden text; balances follow reported usage<\/td><\/tr><\/tbody><\/table><figcaption class=\"wp-element-caption\">Selected results from Wu et al. (2026), arXiv:2611.07650, abstract and Sections V-B and V-E \/ Table VI.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Controlled mixture tests also show limits of accuracy fingerprints: a related cheaper substitute (Astra\u2192Luna) often passed at 10% replacement and was flagged in only 4.0% of simulations at 25%, while Haiku or GLM replacements were usually caught by 25%.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u2705 Why it matters: Three checks beat a price tag<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Unlike fingerprint-only audits, this study ties answer behavior, permission compliance and billed usage together on the same anonymized services, with official API references and two measurement rounds. The authors publish explicit scoring rules, controlled mixtures and what their tests cannot see (message retention, key misuse, gateway compromise). That makes the work unusually useful for buyers who cannot inspect a relay&#8217;s internals.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83e\uddea Method in brief<\/h2>\n\n\n<ul class=\"wp-block-list\"><li><strong>Services:<\/strong> 20 relays offering GPT-6 Astra and Claude Opus 5, selected from ranking sites after access and payment filters; 10 low-price, 10 same- or higher-price. Not a random sample; expanded after a low-price pilot.<\/li><li><strong>Accuracy:<\/strong> Knowledge\/capability bank with ~125 scored relay responses per cell versus batch-matched official chat-completions calls; Benjamini\u2013Hochberg q-values; labels Confirmed \/ Suspected \/ No evidence.<\/li><li><strong>Content:<\/strong> Fixed non-adversarial code and setup workload screened for harmful packages, commands and destinations (3,332 responses).<\/li><li><strong>Billing:<\/strong> Compare reported input tokens to official references; reconcile balance endpoints at six services.<\/li><li><strong>Anonymization:<\/strong> Services labeled R01\u2013R20; identity mapping kept private.<\/li><\/ul>\n\n\n<h2 class=\"wp-block-heading\">\u2753 What remains open<\/h2>\n\n\n<ul class=\"wp-block-list\"><li><strong>No backend proof:<\/strong> An accuracy flag shows behavioral inconsistency, not which model ran. Wrappers, refusals, decoding or retrieval can also move scores.<\/li><li><strong>Price is not destiny:<\/strong> The primary price-tier test misses p = 0.05; three low-price relays had no flag.<\/li><li><strong>Unexplained tokens:<\/strong> A surplus can be an added system prompt or altered accounting; only R11 of the large-surplus group also had a reconcilable balance.<\/li><li><strong>Coverage gaps:<\/strong> No long multi-turn sessions, no credential-leak tests, no software-vulnerability scans; four Astra cells missing from the main table for interface reasons.<\/li><li><strong>Reproducibility:<\/strong> Accompanying anonymized data and plot inputs are mentioned; no public named-service scoreboard. OpenAI Codex polished the manuscript language.<\/li><\/ul>\n\n\n<h2 class=\"wp-block-heading\">\ud83e\udded Context: From shadow APIs to billable middlemen<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Prior work fingerprints models, audits shadow APIs for fake model claims, and probes gateways for consistency and latency. This paper sits closer to buyer due diligence: it treats the relay as an untrusted delivery path whose contract covers quality, permissions and usage reporting at once. For i10X readers who already follow <a href=\"\/news\/product\/chat-gpt\">ChatGPT<\/a> and <a href=\"\/news\/product\/claude\">Claude<\/a> pricing, the practical question is whether a cheaper route still delivers the model they paid for.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udee0\ufe0f What it means for teams buying LLM API access<\/h2>\n\n\n<ul class=\"wp-block-list\"><li><strong>Verify tokens, not just $\/1M:<\/strong> Diff reported input tokens against a small official reference batch; watch cache vs non-cache rates separately.<\/li><li><strong>Enforce tool permissions client-side:<\/strong> Never trust the relay alone\u2014drop unexpected tool calls before execution.<\/li><li><strong>Retest:<\/strong> Flags moved between rounds 11\u201318 days apart; treat relays as living services.<\/li><li><strong>Price is a clue, not a certificate:<\/strong> Some cheap relays looked fine; some same-price ones did not.<\/li><\/ul>\n\n\n<h2 class=\"wp-block-heading\">\u270d\ufe0f About the analysis<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">This article is based on the full text of Wu, Zhao, Li, Cheong, Li and Ni (2026), arXiv:2611.07650v1 (cs.SE, submitted November 5, 2026). All numbers come from the paper; i10X did not retest the relays. The preprint is licensed CC BY 4.0. The chart was redrawn by i10X from the primary price-tier tallies in \u00a7V-B. AI tools assisted with research and drafting; selection, fact-checking and final editing were done by the i10X editorial team. More coverage lives in our <a href=\"\/news\/category\/studies\/benchmarks-evals\">Benchmarks &amp; Evals studies<\/a> and <a href=\"\/news\/category\/infrastructure\">Infrastructure<\/a> section.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udd2d i10x Perspective<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">API relays are infrastructure, not magic discounts. If your product&#8217;s answer quality, tool policy or unit economics depend on GPT or Claude behaving as billed, treat the middleman as part of the threat model\u2014and measure it the way this paper does: answers, permissions and invoices in the same audit.<\/p>\n\n","protected":false},"excerpt":{"rendered":"<p>Queen&#8217;s University tested 20 GPT-6 Astra and Claude Opus 5 relays: 7\/10 cheap ones failed accuracy checks, five inflated input tokens by 4.2k\u201360k, and four ignored tool_choice: none.<\/p>\n","protected":false},"author":2,"featured_media":6959,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"paper_title":"What the Middleman Delivers: Answer Behavior, Tool Permissions, and Billed Usage in LLM API Relays","paper_url":"https:\/\/arxiv.org\/abs\/2611.07650","pdf_url":"https:\/\/arxiv.org\/pdf\/2611.07650v1","doi":"","arxiv_id":"2611.07650","authors":"Xiaodong Wu, Zhimin Zhao, Qi Li, Chaklam Cheong, Xiangman Li, Jianbing Ni","institutions":"Queen's University, Kingston, Ontario, Canada","paper_date":"2026-11-05","venue":"Preprint (arXiv cs.SE, version 1)","peer_reviewed":false,"code_url":"","data_url":"","funding_coi":"No funding or conflict-of-interest statement. Acknowledgment: OpenAI Codex polished manuscript language; authors take responsibility. Services anonymized.","figure_license":"Own chart redrawn from reported primary price-tier tallies (paper CC BY 4.0)","paper_license":"CC BY 4.0","replication":"partial","study_models":"GPT-6 Astra, Claude Opus 5 (official APIs vs 20 anonymized relays); mixture substitutes include Claude Haiku 4.5, GPT-6 Luna, GLM-4.5-Flash","study_sample":"20 relays (10 low-price, 10 same\/higher-price); ~125 scored responses per cell; 3,332 screened content responses; two rounds 11\u201318 days apart","footnotes":"","_yoast_wpseo_primary_category":""},"categories":[53,11,52],"tags":[],"companies":[39,38],"products":[50,51],"class_list":["post-6961","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-benchmarks-evals","category-infrastructure","category-studies","company-anthropic","company-open-ai","product-chat-gpt","product-claude"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>LLM API Relays Mismatch Answers, Tools and Bills - i10X News<\/title>\n<meta name=\"description\" content=\"Queen&#039;s study of 20 GPT\/Claude API relays: 7\/10 cheap ones flagged on accuracy; five over-reported tokens by 4.2k\u201360k; four ignored tool blocks.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"LLM API Relays Mismatch Answers, Tools and Bills - i10X News\" \/>\n<meta property=\"og:description\" content=\"Queen&#039;s study of 20 GPT\/Claude API relays: 7\/10 cheap ones flagged on accuracy; five over-reported tokens by 4.2k\u201360k; four ignored tool blocks.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study\" \/>\n<meta property=\"og:site_name\" content=\"i10X News\" \/>\n<meta property=\"article:published_time\" content=\"2026-11-06T08:50:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/11\/llm-api-relays-answers-tools-billing-study-title.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1344\" \/>\n\t<meta property=\"og:image:height\" content=\"768\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Christopher Ort\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@i10x_ai\" \/>\n<meta name=\"twitter:site\" content=\"@i10x_ai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Christopher Ort\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study\"},\"author\":{\"name\":\"Christopher Ort\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/person\\\/d410bb7ee72febefca2c9c369939219a\"},\"headline\":\"LLM API Relays Often Mismatch Official Answers, Tools and Bills\",\"datePublished\":\"2026-11-06T08:50:13+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study\"},\"wordCount\":1155,\"publisher\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/llm-api-relays-answers-tools-billing-study-title.webp\",\"articleSection\":[\"Benchmarks &amp; Evals\",\"Infrastructure\",\"Studies\"],\"inLanguage\":\"en-US\",\"dateModified\":\"2026-11-06T08:50:13+00:00\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study\",\"url\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study\",\"name\":\"LLM API Relays Mismatch Answers, Tools and Bills - i10X News\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/llm-api-relays-answers-tools-billing-study-title.webp\",\"datePublished\":\"2026-11-06T08:50:13+00:00\",\"description\":\"Queen's study of 20 GPT\\\/Claude API relays: 7\\\/10 cheap ones flagged on accuracy; five over-reported tokens by 4.2k\u201360k; four ignored tool blocks.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study#primaryimage\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/llm-api-relays-answers-tools-billing-study-title.webp\",\"contentUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/llm-api-relays-answers-tools-billing-study-title.webp\",\"width\":1344,\"height\":768,\"caption\":\"Illustration: i10X\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/llm-api-relays-answers-tools-billing-study#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/i10x.ai\\\/news\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"LLM API Relays Often Mismatch Official Answers, Tools and Bills\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#website\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\",\"name\":\"i10X News\",\"description\":\"Stay updated with the latest news and announcements from i10X.\",\"publisher\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/i10x.ai\\\/news?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\",\"name\":\"i10X\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/i10x-logo-180.png\",\"contentUrl\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/i10x-logo-180.png\",\"width\":180,\"height\":180,\"caption\":\"i10X\"},\"image\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/i10x_ai\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/i10x-ai\",\"https:\\\/\\\/instagram.com\\\/i10x.ai\",\"https:\\\/\\\/www.youtube.com\\\/@i10X_ai_official\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/person\\\/d410bb7ee72febefca2c9c369939219a\",\"name\":\"Christopher Ort\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"contentUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"caption\":\"Christopher Ort\"},\"description\":\"Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU). He is the author of \u201cThe Style Penalty\u201d, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/author\\\/christopher-ort\",\"sameAs\":[\"https:\\\/\\\/i10x.ai\\\/blog\\\/author\\\/christopher-ort\"],\"worksFor\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\"},\"alumniOf\":{\"@type\":\"EducationalOrganization\",\"name\":\"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU)\",\"url\":\"https:\\\/\\\/www.fau.eu\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"LLM API Relays Mismatch Answers, Tools and Bills - i10X News","description":"Queen's study of 20 GPT\/Claude API relays: 7\/10 cheap ones flagged on accuracy; five over-reported tokens by 4.2k\u201360k; four ignored tool blocks.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study","og_locale":"en_US","og_type":"article","og_title":"LLM API Relays Mismatch Answers, Tools and Bills - i10X News","og_description":"Queen's study of 20 GPT\/Claude API relays: 7\/10 cheap ones flagged on accuracy; five over-reported tokens by 4.2k\u201360k; four ignored tool blocks.","og_url":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study","og_site_name":"i10X News","article_published_time":"2026-11-06T08:50:13+00:00","og_image":[{"width":1344,"height":768,"url":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/11\/llm-api-relays-answers-tools-billing-study-title.webp","type":"image\/webp"}],"author":"Christopher Ort","twitter_card":"summary_large_image","twitter_creator":"@i10x_ai","twitter_site":"@i10x_ai","twitter_misc":{"Written by":"Christopher Ort","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study#article","isPartOf":{"@id":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study"},"author":{"name":"Christopher Ort","@id":"https:\/\/i10x.ai\/news\/#\/schema\/person\/d410bb7ee72febefca2c9c369939219a"},"headline":"LLM API Relays Often Mismatch Official Answers, Tools and Bills","datePublished":"2026-11-06T08:50:13+00:00","mainEntityOfPage":{"@id":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study"},"wordCount":1155,"publisher":{"@id":"https:\/\/i10x.ai\/news\/#organization"},"image":{"@id":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study#primaryimage"},"thumbnailUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/llm-api-relays-answers-tools-billing-study-title.webp","articleSection":["Benchmarks &amp; Evals","Infrastructure","Studies"],"inLanguage":"en-US","dateModified":"2026-11-06T08:50:13+00:00"},{"@type":"WebPage","@id":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study","url":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study","name":"LLM API Relays Mismatch Answers, Tools and Bills - i10X News","isPartOf":{"@id":"https:\/\/i10x.ai\/news\/#website"},"primaryImageOfPage":{"@id":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study#primaryimage"},"image":{"@id":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study#primaryimage"},"thumbnailUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/llm-api-relays-answers-tools-billing-study-title.webp","datePublished":"2026-11-06T08:50:13+00:00","description":"Queen's study of 20 GPT\/Claude API relays: 7\/10 cheap ones flagged on accuracy; five over-reported tokens by 4.2k\u201360k; four ignored tool blocks.","breadcrumb":{"@id":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study#primaryimage","url":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/llm-api-relays-answers-tools-billing-study-title.webp","contentUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/llm-api-relays-answers-tools-billing-study-title.webp","width":1344,"height":768,"caption":"Illustration: i10X"},{"@type":"BreadcrumbList","@id":"https:\/\/i10xnews.kinsta.cloud\/llm-api-relays-answers-tools-billing-study#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/i10x.ai\/news"},{"@type":"ListItem","position":2,"name":"LLM API Relays Often Mismatch Official Answers, Tools and Bills"}]},{"@type":"WebSite","@id":"https:\/\/i10x.ai\/news\/#website","url":"https:\/\/i10x.ai\/news","name":"i10X News","description":"Stay updated with the latest news and announcements from i10X.","publisher":{"@id":"https:\/\/i10x.ai\/news\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/i10x.ai\/news?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/i10x.ai\/news\/#organization","name":"i10X","url":"https:\/\/i10x.ai\/news\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10x.ai\/news\/#\/schema\/logo\/image\/","url":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/10\/i10x-logo-180.png","contentUrl":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/10\/i10x-logo-180.png","width":180,"height":180,"caption":"i10X"},"image":{"@id":"https:\/\/i10x.ai\/news\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/i10x_ai","https:\/\/www.linkedin.com\/company\/i10x-ai","https:\/\/instagram.com\/i10x.ai","https:\/\/www.youtube.com\/@i10X_ai_official"]},{"@type":"Person","@id":"https:\/\/i10x.ai\/news\/#\/schema\/person\/d410bb7ee72febefca2c9c369939219a","name":"Christopher Ort","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","url":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","contentUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","caption":"Christopher Ort"},"description":"Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU). He is the author of \u201cThe Style Penalty\u201d, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.","url":"https:\/\/i10x.ai\/news\/author\/christopher-ort","sameAs":["https:\/\/i10x.ai\/blog\/author\/christopher-ort"],"worksFor":{"@id":"https:\/\/i10x.ai\/news\/#organization"},"alumniOf":{"@type":"EducationalOrganization","name":"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU)","url":"https:\/\/www.fau.eu"}}]}},"_links":{"self":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/6961","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/comments?post=6961"}],"version-history":[{"count":1,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/6961\/revisions"}],"predecessor-version":[{"id":6965,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/6961\/revisions\/6965"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/media\/6959"}],"wp:attachment":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/media?parent=6961"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/categories?post=6961"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/tags?post=6961"},{"taxonomy":"company","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/companies?post=6961"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/products?post=6961"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}