{"id":7140,"date":"2026-11-11T08:02:59","date_gmt":"2026-11-11T08:02:59","guid":{"rendered":"https:\/\/i10xnews.kinsta.cloud\/?p=7140"},"modified":"2026-11-11T08:02:59","modified_gmt":"2026-11-11T08:02:59","slug":"ai-not-getting-dumber-users-pickier-study","status":"publish","type":"post","link":"https:\/\/i10x.ai\/news\/ai-not-getting-dumber-users-pickier-study","title":{"rendered":"Study: AI Isn&#8217;t Getting Dumber, Users Are Getting Pickier"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">\u26a1 Quick Take<\/h2>\n\n\n<ul class=\"wp-block-list\"><li><strong>The finding:<\/strong> On Chatbot Arena, verdicts on the very same unchanged AI models got harsher every month. Within fixed pairs, &#8220;both answers are bad&#8221; votes rose by 1.71 percentage points a month on a mean of 17.1%, across 1,260,967 blind votes from May 2023 to August 2024.<\/li><li><strong>Why it is convincing:<\/strong> The rise shows up within the same voter, on the same pair, for newcomers from their first vote, in every major language and for pinned OpenAI and Anthropic snapshots. Which model wins, however, did not change.<\/li><li><strong>What it means:<\/strong> &#8220;The model got dumber&#8221; can be true, but it can also be users raising the bar. Absolute ratings of AI need a fixed reference; head-to-head rankings held steady.<\/li><\/ul>\n\n\n<p class=\"wp-block-paragraph\">Complaints that ChatGPT, Claude or Gemini &#8220;got worse&#8221; follow almost every popular model. Sometimes the model behind a name really changes. A working paper by Zihan Chen and Di Zhu (Stevens Institute of Technology) and Lei Nico Zheng (University of Massachusetts Boston), &#8220;AI Isn&#8217;t Getting Dumber, We&#8217;re Getting Pickier: Rising Standards in Human Evaluation of Large Language Models,&#8221; tests the other explanation: that the judges change. Their lab is Chatbot Arena&#8217;s public vote log, where anonymous models compete blind and many of them are frozen versions that never change.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udd2c What the study shows<\/h2>\n\n\n<ul class=\"wp-block-list\"><li><strong>Same models, harsher verdicts:<\/strong> For the same pair of frozen models, the share of &#8220;both are bad&#8221; votes rose by 1.71 points a month (SE 0.18), and by 1.91 points a month in 2024, when 92% of the votes were cast. By August 2024 it stood 17.8 points above its May 2023 level.<\/li><li><strong>No regression needed:<\/strong> In all fourteen pairs judged at least 50 times in both mid-2023 and 2024, the share rose, from 15.5% to 23.3% on a weighted basis. That includes gpt-4-0613 against claude-2.0.<\/li><li><strong>The bar moves, not the ranking:<\/strong> The extra rejections came out of decisive votes; ties stayed flat. In 2024 the stronger model&#8217;s share of decisive votes showed no trend (0.00 points a month, SE 0.13).<\/li><li><strong>People get pickier:<\/strong> Within the same voter identifier, rejections rose 1.90 points a month; for the same voter on the same pair, 2.30. Newcomers arriving later were harsher from their first recorded vote (+1.25 points per month of arrival).<\/li><li><strong>No momentary contrast:<\/strong> Seeing a strong model in the previous battle did not make the next verdict harsher (\u22120.11 points per 100 rating points, not significant).<\/li><li><strong>A treadmill:<\/strong> The average model in battles gained 245 Elo points, so an August 2024 model would be expected to score about 78% against a May 2023 one. Yet platform-wide &#8220;both are bad&#8221; votes were 19.4% in May 2023 and 20.6% in August 2024.<\/li><\/ul>\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1344\" height=\"768\" src=\"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/11\/chart-arena-both-bad-trend.webp\" alt=\"Bar chart: monthly rise in both-are-bad votes on Chatbot Arena for unchanged model pairs: main estimate +1.71 points, 2024 only +1.91, OpenAI and Anthropic snapshots +1.41, open-weight models +2.12, length-stable snapshots +0.97, easy English prompts +1.30, same voter +1.90, same voter and pair +2.30, newcomers' first vote +1.25.\" class=\"wp-image-7139\" srcset=\"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/chart-arena-both-bad-trend.webp 1344w, https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/chart-arena-both-bad-trend-300x171.webp 300w, https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/chart-arena-both-bad-trend-1024x585.webp 1024w, https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/chart-arena-both-bad-trend-768x439.webp 768w\" sizes=\"auto, (max-width: 1344px) 100vw, 1344px\" \/><figcaption class=\"wp-element-caption\">i10X chart based on data from Chen, Zheng &amp; Zhu (2026), arXiv:2611.14333, Tables 2\u20134.<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-table\"><table><thead><tr><th>Outcome (frozen pairs)<\/th><th>Change per month<\/th><th>Mean<\/th><\/tr><\/thead><tbody><tr><td>\u201cBoth are bad\u201d<\/td><td>+1.71 pp<\/td><td>17.1%<\/td><\/tr><tr><td>One answer wins<\/td><td>\u22121.62 pp<\/td><td>63.9%<\/td><\/tr><tr><td>Tie<\/td><td>\u22120.09 pp<\/td><td>19.0%<\/td><\/tr><tr><td>Stronger model wins (decisive votes)<\/td><td>+0.13 pp<\/td><td>66.7%<\/td><\/tr><tr><td>Stronger model wins, 2024 only<\/td><td>0.00 pp<\/td><td>66.5%<\/td><\/tr><\/tbody><\/table><figcaption class=\"wp-element-caption\">Absolute versus relative verdicts, May 2023 to August 2024 unless noted. From Chen, Zheng &amp; Zhu (2026), arXiv:2611.14333, Table 2.<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">\u2705 Why it matters: a natural experiment in blind judging<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Arena happens to offer what the question needs: unchanged products, judged blind by the public, over more than a year, with every verdict time-stamped. The authors hold the model pair fixed with pair fixed effects, so any trend must come from the judges, the prompts or the platform, and then test each alternative. Prompt controls (language, code, math, seven difficulty tags, conversation length, refusals) barely move the estimate, from +1.71 to +1.57. Under Oster&#8217;s coefficient-stability test, hidden prompt differences would need to be 36 times as strong as the observed ones to erase the trend. Interface changes were tracked via 56 commits to the battle page; jumps at major changes looked like jumps at placebo dates. Across 28 robustness specifications the trend is positive in every one, ranging from +0.97 to +2.61 points a month. The final test is out of sample: month effects estimated from other models&#8217; pairs cut the average per-model trend from +1.40 to +0.19 points a month.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83e\uddea Method in brief<\/h2>\n\n\n<ul class=\"wp-block-list\"><li><strong>Data:<\/strong> LMSYS&#8217;s public Arena battle log released in August 2024 (1,799,991 battles). From May 1, 2023, when the &#8220;both are bad&#8221; button existed, 1,795,852 blind battles; 1,260,967 of them pair two frozen models.<\/li><li><strong>Frozen models:<\/strong> 33 dated API snapshots (such as gpt-4-0314 or claude-3-opus-20240229) and 73 fixed open-weight models; 23 aliases that may change were excluded. 2,231 frozen pairs.<\/li><li><strong>Analysis:<\/strong> Linear probability models with pair fixed effects and standard errors clustered by pair and week; judge identifier and identifier-by-pair fixed effects; arrival cohorts using first votes; Bradley\u2013Terry ratings to define the stronger model.<\/li><li><strong>Serving check:<\/strong> Answer-length trends identified 8 length-stable models out of 40 checked, used as a separate test against hidden serving changes.<\/li><\/ul>\n\n\n<h2 class=\"wp-block-heading\">\u2753 What remains open<\/h2>\n\n\n<ul class=\"wp-block-list\"><li><strong>Old data:<\/strong> The log ends in August 2024 and covers models like GPT-4 and Claude 3. Whether standards keep rising at this pace with today&#8217;s models is untested.<\/li><li><strong>Who votes:<\/strong> Arena voters are a self-selected, AI-curious public. The judge identifier tracks a device or network, not a person.<\/li><li><strong>No text:<\/strong> The log has no prompt or answer text, so identical prompts cannot be compared directly.<\/li><li><strong>Mechanism:<\/strong> The data cannot separate a higher threshold from closer scrutiny, nor link verdicts to each voter&#8217;s exposure to other AI. Platform quality rose almost in step with calendar time (correlation .99).<\/li><li><strong>Status:<\/strong> A working paper, not peer reviewed; no code release or funding statement is given, though the underlying data are public.<\/li><\/ul>\n\n\n<h2 class=\"wp-block-heading\">\ud83e\udded Context: from &#8220;is ChatGPT changing?&#8221; to &#8220;are we?&#8221;<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Chen, Zaharia and Zou showed that the March and June 2023 versions of the model behind ChatGPT behaved differently on several tasks, so model drift is real. Work on Arena itself found rankings sensitive to sampling (&#8220;The Leaderboard Illusion&#8221;) and to dropping a handful of votes. This paper adds a third factor, drifting human standards, and borrows theory from marketing and psychology: adaptation-level theory and the &#8220;hedonic treadmill&#8221;. It mirrors reputation inflation on online marketplaces, but in reverse. It also gives context to recent user complaints we analysed in <a href=\"\/news\/claude-opus-5-5-nerf-complaints-data\">the data behind Claude Opus 5.5 &#8220;nerf&#8221; claims<\/a> and to our coverage of <a href=\"\/news\/llm-judge-bias-hard-tasks\">bias in LLM judges<\/a>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udee0\ufe0f What it means for AI teams and buyers<\/h2>\n\n\n<ul class=\"wp-block-list\"><li><strong>Read complaints carefully:<\/strong> A falling satisfaction score does not prove a regression. Keep frozen reference models or fixed prompt-answer pairs in your evaluations to tell product changes from rising expectations.<\/li><li><strong>Prefer relative judgments over time:<\/strong> Head-to-head preferences stayed stable; absolute &#8220;good enough&#8221; labels drifted by roughly 21 points a year.<\/li><li><strong>Time-stamp human feedback:<\/strong> Acceptability labels collected in different periods encode different standards, which matters for RLHF datasets and quality thresholds.<\/li><li><strong>Standing still loses:<\/strong> For vendors, a model that does not improve will be judged as declining as the market moves.<\/li><\/ul>\n\n\n<p class=\"wp-block-paragraph\">More on our <a href=\"\/news\/category\/studies\/benchmarks-evals\">Benchmarks &amp; Evals<\/a> page.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u270d\ufe0f About the analysis<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">This article is based on the full text of Chen, Zheng and Zhu (2026), &#8220;AI Isn&#8217;t Getting Dumber, We&#8217;re Getting Pickier: Rising Standards in Human Evaluation of Large Language Models,&#8221; arXiv:2611.14333v1 (cs.HC, working paper, submitted November 10, 2026), including the appendix tables. All numbers come from the paper. The chart was redrawn by i10X from Tables 2\u20134; the paper is licensed CC BY 4.0. No funding or conflict-of-interest statement is included. AI tools assisted with research and drafting; selection, fact-checking and final editing were done by the i10X editorial team.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udd2d i10x Perspective<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">This is the most useful reality check on &#8220;AI got worse&#8221; threads we have seen: it does not deny model changes, it shows that the yardstick moves too. The lesson for anyone running evals is simple and cheap: keep a few frozen references in the mix. The lesson for users is humbling: yesterday&#8217;s wow answer is today&#8217;s &#8220;both are bad&#8221;.<\/p>\n\n","protected":false},"excerpt":{"rendered":"<p>1.26 million blind Chatbot Arena votes show verdicts on unchanged AI models getting harsher every month, while rankings stay stable. The bar moves, not the models.<\/p>\n","protected":false},"author":2,"featured_media":7138,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"paper_title":"AI Isn't Getting Dumber, We're Getting Pickier: Rising Standards in Human Evaluation of Large Language Models","paper_url":"https:\/\/arxiv.org\/abs\/2611.14333","pdf_url":"https:\/\/arxiv.org\/pdf\/2611.14333","doi":"","arxiv_id":"2611.14333","authors":"Zihan Chen, Lei Nico Zheng, Di Zhu","institutions":"Stevens Institute of Technology, University of Massachusetts Boston","paper_date":"2026-11-10","venue":"arXiv (cs.HC), working paper, version 1","peer_reviewed":false,"code_url":"","data_url":"https:\/\/storage.googleapis.com\/arena_external_data\/public\/clean_battle_20240814_public.json","funding_coi":"No funding or conflict-of-interest statement included.","figure_license":"Own chart redrawn from Tables 2\u20134 (paper CC BY 4.0)","paper_license":"CC BY 4.0","replication":"partial","study_models":"129 Chatbot Arena models (2023\u20132024); 106 frozen: 33 dated API snapshots (e.g. gpt-4-0613, claude-3-opus-20240229) and 73 fixed open-weight models","study_sample":"1,260,967 blind votes on 2,231 frozen model pairs, May 2023 \u2013 August 2024 (public LMSYS battle log)","footnotes":"","_yoast_wpseo_primary_category":"","_nx_sec_severity":"","_nx_sec_affected":"","_nx_sec_status":"","_nx_sec_kicker":""},"categories":[59,52],"tags":[],"companies":[39,38],"products":[50],"class_list":["post-7140","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-society-economy","category-studies","company-anthropic","company-open-ai","product-chat-gpt"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>AI Isn&#039;t Getting Dumber, Users Are Getting Pickier - i10X News<\/title>\n<meta name=\"description\" content=\"Is AI getting worse? A study of 1.26M blind Chatbot Arena votes finds verdicts on unchanged models harsher each month, while model rankings stay stable.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI Isn&#039;t Getting Dumber, Users Are Getting Pickier - i10X News\" \/>\n<meta property=\"og:description\" content=\"Is AI getting worse? A study of 1.26M blind Chatbot Arena votes finds verdicts on unchanged models harsher each month, while model rankings stay stable.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study\" \/>\n<meta property=\"og:site_name\" content=\"i10X News\" \/>\n<meta property=\"article:published_time\" content=\"2026-11-11T08:02:59+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/11\/ai-not-getting-dumber-users-pickier-study-title.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1344\" \/>\n\t<meta property=\"og:image:height\" content=\"768\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Christopher Ort\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@i10x_ai\" \/>\n<meta name=\"twitter:site\" content=\"@i10x_ai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Christopher Ort\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study\"},\"author\":{\"name\":\"Christopher Ort\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/person\\\/d410bb7ee72febefca2c9c369939219a\"},\"headline\":\"Study: AI Isn&#8217;t Getting Dumber, Users Are Getting Pickier\",\"datePublished\":\"2026-11-11T08:02:59+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study\"},\"wordCount\":1248,\"publisher\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/ai-not-getting-dumber-users-pickier-study-title.webp\",\"articleSection\":[\"Society &amp; Economy\",\"Studies\"],\"inLanguage\":\"en-US\",\"dateModified\":\"2026-11-11T08:02:59+00:00\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study\",\"url\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study\",\"name\":\"AI Isn't Getting Dumber, Users Are Getting Pickier - i10X News\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/ai-not-getting-dumber-users-pickier-study-title.webp\",\"datePublished\":\"2026-11-11T08:02:59+00:00\",\"description\":\"Is AI getting worse? A study of 1.26M blind Chatbot Arena votes finds verdicts on unchanged models harsher each month, while model rankings stay stable.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study#primaryimage\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/ai-not-getting-dumber-users-pickier-study-title.webp\",\"contentUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/ai-not-getting-dumber-users-pickier-study-title.webp\",\"width\":1344,\"height\":768,\"caption\":\"Illustration: i10X\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/ai-not-getting-dumber-users-pickier-study#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/i10x.ai\\\/news\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Study: AI Isn&#8217;t Getting Dumber, Users Are Getting Pickier\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#website\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\",\"name\":\"i10X News\",\"description\":\"Stay updated with the latest news and announcements from i10X.\",\"publisher\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/i10x.ai\\\/news?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\",\"name\":\"i10X\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/i10x-logo-180.png\",\"contentUrl\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/i10x-logo-180.png\",\"width\":180,\"height\":180,\"caption\":\"i10X\"},\"image\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/i10x_ai\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/i10x-ai\",\"https:\\\/\\\/instagram.com\\\/i10x.ai\",\"https:\\\/\\\/www.youtube.com\\\/@i10X_ai_official\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/person\\\/d410bb7ee72febefca2c9c369939219a\",\"name\":\"Christopher Ort\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"contentUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"caption\":\"Christopher Ort\"},\"description\":\"Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU). He is the author of \u201cThe Style Penalty\u201d, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/author\\\/christopher-ort\",\"sameAs\":[\"https:\\\/\\\/i10x.ai\\\/blog\\\/author\\\/christopher-ort\"],\"worksFor\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\"},\"alumniOf\":{\"@type\":\"EducationalOrganization\",\"name\":\"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU)\",\"url\":\"https:\\\/\\\/www.fau.eu\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"AI Isn't Getting Dumber, Users Are Getting Pickier - i10X News","description":"Is AI getting worse? A study of 1.26M blind Chatbot Arena votes finds verdicts on unchanged models harsher each month, while model rankings stay stable.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study","og_locale":"en_US","og_type":"article","og_title":"AI Isn't Getting Dumber, Users Are Getting Pickier - i10X News","og_description":"Is AI getting worse? A study of 1.26M blind Chatbot Arena votes finds verdicts on unchanged models harsher each month, while model rankings stay stable.","og_url":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study","og_site_name":"i10X News","article_published_time":"2026-11-11T08:02:59+00:00","og_image":[{"width":1344,"height":768,"url":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/11\/ai-not-getting-dumber-users-pickier-study-title.webp","type":"image\/webp"}],"author":"Christopher Ort","twitter_card":"summary_large_image","twitter_creator":"@i10x_ai","twitter_site":"@i10x_ai","twitter_misc":{"Written by":"Christopher Ort","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study#article","isPartOf":{"@id":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study"},"author":{"name":"Christopher Ort","@id":"https:\/\/i10x.ai\/news\/#\/schema\/person\/d410bb7ee72febefca2c9c369939219a"},"headline":"Study: AI Isn&#8217;t Getting Dumber, Users Are Getting Pickier","datePublished":"2026-11-11T08:02:59+00:00","mainEntityOfPage":{"@id":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study"},"wordCount":1248,"publisher":{"@id":"https:\/\/i10x.ai\/news\/#organization"},"image":{"@id":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study#primaryimage"},"thumbnailUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/ai-not-getting-dumber-users-pickier-study-title.webp","articleSection":["Society &amp; Economy","Studies"],"inLanguage":"en-US","dateModified":"2026-11-11T08:02:59+00:00"},{"@type":"WebPage","@id":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study","url":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study","name":"AI Isn't Getting Dumber, Users Are Getting Pickier - i10X News","isPartOf":{"@id":"https:\/\/i10x.ai\/news\/#website"},"primaryImageOfPage":{"@id":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study#primaryimage"},"image":{"@id":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study#primaryimage"},"thumbnailUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/ai-not-getting-dumber-users-pickier-study-title.webp","datePublished":"2026-11-11T08:02:59+00:00","description":"Is AI getting worse? A study of 1.26M blind Chatbot Arena votes finds verdicts on unchanged models harsher each month, while model rankings stay stable.","breadcrumb":{"@id":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study#primaryimage","url":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/ai-not-getting-dumber-users-pickier-study-title.webp","contentUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/ai-not-getting-dumber-users-pickier-study-title.webp","width":1344,"height":768,"caption":"Illustration: i10X"},{"@type":"BreadcrumbList","@id":"https:\/\/i10xnews.kinsta.cloud\/ai-not-getting-dumber-users-pickier-study#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/i10x.ai\/news"},{"@type":"ListItem","position":2,"name":"Study: AI Isn&#8217;t Getting Dumber, Users Are Getting Pickier"}]},{"@type":"WebSite","@id":"https:\/\/i10x.ai\/news\/#website","url":"https:\/\/i10x.ai\/news","name":"i10X News","description":"Stay updated with the latest news and announcements from i10X.","publisher":{"@id":"https:\/\/i10x.ai\/news\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/i10x.ai\/news?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/i10x.ai\/news\/#organization","name":"i10X","url":"https:\/\/i10x.ai\/news\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10x.ai\/news\/#\/schema\/logo\/image\/","url":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/10\/i10x-logo-180.png","contentUrl":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/10\/i10x-logo-180.png","width":180,"height":180,"caption":"i10X"},"image":{"@id":"https:\/\/i10x.ai\/news\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/i10x_ai","https:\/\/www.linkedin.com\/company\/i10x-ai","https:\/\/instagram.com\/i10x.ai","https:\/\/www.youtube.com\/@i10X_ai_official"]},{"@type":"Person","@id":"https:\/\/i10x.ai\/news\/#\/schema\/person\/d410bb7ee72febefca2c9c369939219a","name":"Christopher Ort","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","url":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","contentUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","caption":"Christopher Ort"},"description":"Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU). He is the author of \u201cThe Style Penalty\u201d, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.","url":"https:\/\/i10x.ai\/news\/author\/christopher-ort","sameAs":["https:\/\/i10x.ai\/blog\/author\/christopher-ort"],"worksFor":{"@id":"https:\/\/i10x.ai\/news\/#organization"},"alumniOf":{"@type":"EducationalOrganization","name":"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU)","url":"https:\/\/www.fau.eu"}}]}},"_links":{"self":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/7140","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/comments?post=7140"}],"version-history":[{"count":1,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/7140\/revisions"}],"predecessor-version":[{"id":7145,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/7140\/revisions\/7145"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/media\/7138"}],"wp:attachment":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/media?parent=7140"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/categories?post=7140"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/tags?post=7140"},{"taxonomy":"company","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/companies?post=7140"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/products?post=7140"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}