{"id":8935,"date":"2026-11-14T07:29:09","date_gmt":"2026-11-14T07:29:09","guid":{"rendered":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents"},"modified":"2026-11-14T07:29:09","modified_gmt":"2026-11-14T07:29:09","slug":"deepnote-agent-initiative-benchmark-proactive-ai-agents","status":"publish","type":"post","link":"https:\/\/i10x.ai\/news\/deepnote-agent-initiative-benchmark-proactive-ai-agents","title":{"rendered":"Agent Initiative Benchmark: GPT-6 Astra Leads, and Most AI Agents Can&#8217;t Stay Quiet"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Every office has that colleague who replies to every Slack thread, needed or not. It turns out most AI models are that colleague. Deepnote&#8217;s new <a href=\"https:\/\/deepnote.com\/research\/benchmark\" target=\"_blank\" rel=\"noreferrer noopener\">Agent Initiative Benchmark<\/a>, released on November 13, 2026, dropped 12 frontier models into the Slack of a synthetic software company and measured whether they knew when to help, how to help, and when to stay quiet. <a href=\"https:\/\/i10x.ai\/news\/company\/open-ai\">OpenAI<\/a> models took the top two spots, with GPT-6 Astra at 8.97 out of 10 and GPT-6.1 Sol at 8.65, ahead of <a href=\"https:\/\/i10x.ai\/news\/company\/anthropic\">Anthropic<\/a>&#8216;s Claude Fable 5.2 at 8.17. The more useful finding for anyone building agents: models are good at helping and bad at not helping.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u26a1 Quick Take<\/h2>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>What it is:<\/strong> An open benchmark from Deepnote that tests &#8220;proactive&#8221; agents: AI that watches a company&#8217;s Slack and steps in only when useful, across 50 situations and eight task types.<\/li><li><strong>The test bed:<\/strong> PageMantle, a synthetic company with six years of connected records and about 10 GB of data across 11 services, including Slack, Notion, Linear, HubSpot, Stripe, PostHog, BigQuery and Snowflake.<\/li><li><strong>The ranking:<\/strong> GPT-6 Astra (8.97), GPT-6.1 Sol (8.65), Claude Fable 5.2 (8.17), Claude Opus 5.5 (7.84). Grok 4.7 finished last at 4.51, Gemini 4 Argon second to last at 5.60.<\/li><li><strong>Cost shock:<\/strong> Sol cost $0.11 per task against $1.87 for Fable 5.2. GPT-6 Luna and Claude Fable 5.1 are 430 times apart in price but only 1.1 points apart in score.<\/li><li><strong>Biggest weakness:<\/strong> When silence was the right answer, models held back only 6 times out of 10 on average.<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">In plain English<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Companies want AI helpers that sit in their chat tools and jump in when something goes wrong, like a sales team promising a launch date that engineering just moved. Deepnote built a fake company and tested 12 AI models on 50 such moments. OpenAI&#8217;s models did best, and some cheap models did nearly as well as very expensive ones. The most common mistake was not staying silent when nobody needed help.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What happened<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Deepnote, which builds a data workspace &#8220;where agents and people work on data together,&#8221; published the benchmark with an open dataset on Hugging Face and simulated service APIs plus example tasks on <a href=\"https:\/\/github.com\/deepnote\/agent-initiative-benchmark\" target=\"_blank\" rel=\"noreferrer noopener\">GitHub<\/a>. Founder Jakub Jurovych introduced it on X with the question &#8220;What&#8217;s the best model for proactive agents?&#8221;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The setup is deliberately identical for every model: same instructions, same tools, same company snapshot, high reasoning effort and a 180-second budget of model response time (tool execution is not counted). In each run the agent sees the newest Slack messages and one standing instruction: assess what is going on and help if it is useful. It can search and read across all 11 services, including writing SQL against BigQuery and Snowflake, then post in a channel, reply in a thread, send a direct message, or do nothing. Two LLM evaluators, blind to which model they are grading, score each run from 0 to 10 against a reference solution on four dimensions: intervention or silence, content and evidence, clarity and tone, and audience and location.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The results<\/h2>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th>Model<\/th><th>Score (0-10)<\/th><th>Cost per task<\/th><th>Avg. time<\/th><th>Tool calls<\/th><th>Stayed silent<\/th><\/tr><\/thead><tbody><tr><td>GPT-6 Astra<\/td><td>8.97<\/td><td>$0.693<\/td><td>54 s<\/td><td>19.3<\/td><td>8\/10<\/td><\/tr><tr><td>GPT-6.1 Sol<\/td><td>8.65<\/td><td>$0.112<\/td><td>54 s<\/td><td>18.0<\/td><td>8\/10<\/td><\/tr><tr><td>Claude Fable 5.2<\/td><td>8.17<\/td><td>$1.87<\/td><td>60 s<\/td><td>20.9<\/td><td>6\/10<\/td><\/tr><tr><td>Claude Opus 5.5<\/td><td>7.84<\/td><td>$1.28<\/td><td>29 s<\/td><td>10.0<\/td><td>8\/10<\/td><\/tr><tr><td>Claude Fable 5.1<\/td><td>7.50<\/td><td>$3.02<\/td><td>51 s<\/td><td>14.5<\/td><td>6\/10<\/td><\/tr><tr><td>Claude Sonnet 5.5<\/td><td>6.65<\/td><td>$0.420<\/td><td>15 s<\/td><td>8.9<\/td><td>6\/10<\/td><\/tr><tr><td>GPT-6 Luna<\/td><td>6.38<\/td><td>$0.0070<\/td><td>50 s<\/td><td>13.7<\/td><td>4\/10<\/td><\/tr><tr><td>DeepSeek V4.1 Flash<\/td><td>6.35<\/td><td>$0.026<\/td><td>86 s<\/td><td>21.1<\/td><td>4\/10<\/td><\/tr><tr><td>Mistral Large 4<\/td><td>6.09<\/td><td>$0.082<\/td><td>85 s<\/td><td>22.5<\/td><td>4\/10<\/td><\/tr><tr><td>Claude Haiku 5.5<\/td><td>6.05<\/td><td>$0.075<\/td><td>28 s<\/td><td>12.1<\/td><td>5\/10<\/td><\/tr><tr><td>Gemini 4 Argon<\/td><td>5.60<\/td><td>$0.403<\/td><td>164 s<\/td><td>34.5<\/td><td>10\/10<\/td><\/tr><tr><td>Grok 4.7<\/td><td>4.51<\/td><td>$0.425<\/td><td>145 s<\/td><td>35.5<\/td><td>6\/10<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Source: Deepnote Research. &#8220;Stayed silent&#8221; counts the 10 tasks where the right move was to say nothing. Cost is recorded model spend per task.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Deepnote is careful about uncertainty. Sol&#8217;s score sits inside Astra&#8217;s 95% interval, &#8220;so this task set does not separate them,&#8221; the company writes. Fable 5.2 is below Astra&#8217;s interval but inside Sol&#8217;s. The bottom of the table is driven by timeouts: Gemini 4 Argon and Grok 4.7 hit the 180-second limit without sending a message in 27 and 18 runs, and scored zero on 17 and 20 tasks.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What the benchmark reveals<\/h2>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>Expensive is not better.<\/strong> &#8220;The three priciest models finish third, fourth, and fifth,&#8221; Deepnote writes. A month of watching about 2,500 Slack threads would cost $281 on Sol and $4,684 on Fable 5.2, by its estimate.<\/li><li><strong>Silence is the hard part.<\/strong> When help was needed, a message went out 9 times in 10. When silence was right, models held back only 6 times in 10. Speaking out of turn also cost about 1.8 times as much as staying quiet.<\/li><li><strong>Two working styles.<\/strong> Deepnote calls them &#8220;snipers or deep thinkers.&#8221; Opus 5.5 answers in 29 seconds with 10 tool calls. Fable 5.2 makes twice the calls in twice the time for a score 4% higher.<\/li><li><strong>More tool calls, lower scores.<\/strong> Gemini 4 Argon averaged 35 tool calls, Grok 4.7 averaged 36, and both landed at the bottom.<\/li><li><strong>Numbers are the weak spot.<\/strong> Analyze tasks, which require pulling figures from analytics or warehouse data and checking them against a claim in Slack, were the weakest type for 8 of 12 models.<\/li><\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">One example task shows the difference. A customer success manager asks which of three customers needs attention first. Only models that opened a report linked from a Linear ticket found that one customer&#8217;s preview pages were wrong. GPT-6.1 Sol and Claude Fable 5.2 scored 10; Gemini 4 Argon and <a href=\"https:\/\/i10x.ai\/news\/product\/grok\">Grok<\/a> 4.7 hit the time limit after 48 and 56 tool calls without replying.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Pros and cons<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">For users (teams working with agents)<\/h3>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>Pro:<\/strong> Clear evidence that a well-chosen model can catch real coordination mistakes, like a sales promise that contradicts the release plan.<\/li><li><strong>Con:<\/strong> Even the best models spoke up in 2 of 10 situations where they should have stayed quiet. Deepnote notes those messages were well written, so they are hard to filter out.<\/li><\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">For developers<\/h3>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>Pro:<\/strong> Open data and simulated APIs to test your own agent, plus practical advice: route by task complexity, make &#8220;is this already handled?&#8221; an explicit step, and cap the search budget.<\/li><li><strong>Con:<\/strong> Results compare models under one fixed harness. Deepnote itself warns that &#8220;a different prompt, tool policy, or retrieval step will move every number here.&#8221;<\/li><\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">For companies<\/h3>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>Pro:<\/strong> A cost lens that matters for always-on agents, where a model runs on every thread, not once per question.<\/li><li><strong>Con:<\/strong> 50 tasks, one effort level and one synthetic company. Rankings by task type rest on 5 to 8 tasks each and should be treated as tendencies.<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">What X is saying<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Jakub Jurovych&#8217;s launch thread summed up the headlines:<\/p>\n\n\n\n<blockquote class=\"twitter-tweet i10x-x-embed\"><p lang=\"en\" dir=\"ltr\">What\u2019s the best model for proactive agents?<br><br>Today, we\u2019re introducing the Agent Initiative Benchmark. We tested 12 frontier models on realistic workplace tasks inside a synthetic company with 6 years of highly detailed history: it has a financial model, CRM records, past-due invoices, Linear tickets, and real-life events affecting company development &#8211; competitor product announcements, SVB collapse, etc.<br><br>We used the company\u2019s Slack to test how a proactive agent listening in on each conversation would assist the team in day-to-day tasks: from stepping in to align initiatives across teams to warning the team not to use an unapproved customer logo.<br><br>Highlights:<br><br>&#8211; 6.1 Sol and Astra from @OpenAIDevs beat Anthropic&#x27;s latest Fable 5.2, with Sol crushing it at both performance and cost ($0.11 per task vs $1.87).<br>&#8211; The most expensive models aren&#x27;t the best: Fable 5.1 is 430x more expensive than GPT-6 Luna, with similar performance.<br>&#8211; Most models try to help even if they&#x27;re not needed. Interestingly, in these failure cases, they spend more time thinking, and the unnecessary work takes about 80% more time and money than if they stayed quiet.<br><br>If you\u2019re building agents, keep reading for more tips on which model is best for your use case. Detailed breakdown, the open-source dataset, and benchmark code below:<\/p>&mdash; Jakub Jurovych (@jakubjurovych) <a href=\"https:\/\/x.com\/jakubjurovych\/status\/2121256499552915586\" target=\"_blank\" rel=\"noreferrer noopener\">November 13, 2026 \u00b7 View on X<\/a><\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">The price gap got the most attention:<\/p>\n\n\n\n<blockquote class=\"twitter-tweet i10x-x-embed\"><p lang=\"en\" dir=\"ltr\">GPT-6 Luna is 430x cheaper than Claude Fable 5.1 as an always-on Slack agent , and only 1.1 points behind<br><br>&gt; Luna : 6.38\/10 , $0.007 a task<br>&gt; Fable 5.1 : 7.50\/10 , $3.02 a task<br><br>a proactive agent that reads every thread can&#x27;t cost $3 a read<\/p>&mdash; Chetaslua (@chetaslua) <a href=\"https:\/\/x.com\/chetaslua\/status\/2121259512414032320\" target=\"_blank\" rel=\"noreferrer noopener\">November 13, 2026 \u00b7 View on X<\/a><\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">Santiago (@svpino), a longtime Deepnote user by his own account, broke down the test design:<\/p>\n\n\n\n<blockquote class=\"twitter-tweet i10x-x-embed\"><p lang=\"en\" dir=\"ltr\">This is a really good test for agents:<br><br>It&#x27;s a benchmark released by Deepnote. (I&#x27;ve used their platform for 5+ years and I love it!)<br><br>The benchmark tests agents in a simulated company&#x27;s Slack:<br><br>\u2022 Agents get access to records across 11 services<br>\u2022 They face 50 different situations<br>\u2022 They have 3 minutes to investigate and decide<br><br>Here is what they test:<br><br>1. Does the agent know when to help?<br>2. Does the agent know how to help accurately?<br>3. Does the agent know when to stay quiet?<\/p>&mdash; Santiago (@svpino) <a href=\"https:\/\/x.com\/svpino\/status\/2121263819565703493\" target=\"_blank\" rel=\"noreferrer noopener\">November 13, 2026 \u00b7 View on X<\/a><\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">Others turned it into office humor. &#8220;Every team already has that one coworker. Now we pay per token for it,&#8221; <a href=\"https:\/\/x.com\/rfanazhari\/status\/2121446595023814845\" target=\"_blank\" rel=\"noreferrer noopener\">@rfanazhari<\/a> wrote. <a href=\"https:\/\/x.com\/adrianhsuu\/status\/2121274916200980498\" target=\"_blank\" rel=\"noreferrer noopener\">@adrianhsuu<\/a> noted the week&#8217;s irony: &#8220;Fable 5.2 won the week. It&#8217;s still not the model I&#8217;d leave in Slack.&#8221; i10x did not find a Grok assessment of the benchmark on X.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Critical analysis<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">This is one of the more thoughtful agent benchmarks released this year. It publishes intervals, zero counts, costs and limitations, and it tests a behavior most evaluations ignore: restraint. Still, three caveats apply. First, scoring relies on LLM judges, which can share blind spots with the models they grade, even when blinded. Second, Deepnote builds an agent workspace and is not a neutral party in the agent market, though the benchmark compares models rather than products. Third, the 180-second limit shapes the ranking. Models that investigate thoroughly but slowly, such as Gemini 4 Argon, are punished hard, which is realistic for a live Slack thread but less so for background work. Deepnote acknowledges this and says a harness benchmark is next.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For <a href=\"https:\/\/i10x.ai\/news\/product\/gemini\">Gemini<\/a> and Grok, the result is a warning sign rather than a verdict: both lost most of their points to timeouts, not to bad answers.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What&#8217;s still open<\/h2>\n\n\n\n<ul class=\"wp-block-list\"><li>How rankings change at lower or higher reasoning effort. Deepnote ran only &#8220;high.&#8221;<\/li><li>Whether a router that sends routine threads to cheap models and hard ones to strong models beats any single model. Deepnote recommends it but did not test it.<\/li><li>How newer models, including the rumored GPT-6.2 release, perform on the same tasks.<\/li><li>Whether results hold with real company data rather than a synthetic company.<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">\u270d\ufe0f About the analysis<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">This independent i10x analysis is based on Deepnote&#8217;s benchmark page, its GitHub repository and public posts on X. i10x did not rerun the benchmark.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li><a href=\"https:\/\/deepnote.com\/research\/benchmark\" target=\"_blank\" rel=\"noreferrer noopener\">Deepnote Research: Agent Initiative Benchmark<\/a><\/li><li><a href=\"https:\/\/github.com\/deepnote\/agent-initiative-benchmark\" target=\"_blank\" rel=\"noreferrer noopener\">GitHub: deepnote\/agent-initiative-benchmark<\/a><\/li><li><a href=\"https:\/\/x.com\/jakubjurovych\/status\/2121256499552915586\" target=\"_blank\" rel=\"noreferrer noopener\">Jakub Jurovych on X, November 13, 2026<\/a><\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udd2d i10x Perspective<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The leaderboard will change with the next model release. The finding about silence will not. An always-on agent that is right 9 times in 10 but interrupts when it should not will be muted by its team within a week, however polished its messages. Deepnote&#8217;s best advice is also its simplest: make &#8220;is this already handled?&#8221; an explicit step, and track false alarms as their own metric. For teams choosing a model today, the cost table is the real headline. Sol delivers near-top quality at a fraction of the price, which makes always-on agents affordable for companies that could not justify $4,700 a month for one Slack bot.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Deepnote put 12 frontier models into the Slack of a synthetic company and scored when they helped and when they held back. GPT-6 Astra (8.97) and GPT-6.1 Sol (8.65) beat Claude Fable 5.2 (8.17), Sol at $0.11 per task versus $1.87, and nearly every model found it harder to stay quiet than to speak.<\/p>\n","protected":false},"author":2,"featured_media":8934,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"paper_title":"","paper_url":"","pdf_url":"","doi":"","arxiv_id":"","authors":"","institutions":"","paper_date":"","venue":"","peer_reviewed":false,"code_url":"","data_url":"","funding_coi":"","figure_license":"","paper_license":"","replication":"","study_models":"","study_sample":"","footnotes":"","_yoast_wpseo_primary_category":"14","_nx_sec_severity":"","_nx_sec_affected":"","_nx_sec_status":"","_nx_sec_kicker":"","_nx_sec_type":"","_nx_sec_vendor":"","_nx_sec_fixed":"","_nx_sec_action":""},"categories":[14,3,9,2],"tags":[],"companies":[39,38],"products":[],"class_list":["post-8935","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-agents","category-anthropic","category-models","category-open-ai","company-anthropic","company-open-ai"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Agent Initiative Benchmark: GPT-6 Astra Tops 12 Models - i10X News<\/title>\n<meta name=\"description\" content=\"Deepnote&#039;s Agent Initiative Benchmark tested 12 models in a synthetic company&#039;s Slack. GPT-6 Astra led at 8.97\/10; most models struggled to stay quiet.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Agent Initiative Benchmark: GPT-6 Astra Tops 12 Models - i10X News\" \/>\n<meta property=\"og:description\" content=\"Deepnote&#039;s Agent Initiative Benchmark tested 12 models in a synthetic company&#039;s Slack. GPT-6 Astra led at 8.97\/10; most models struggled to stay quiet.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents\" \/>\n<meta property=\"og:site_name\" content=\"i10X News\" \/>\n<meta property=\"article:published_time\" content=\"2026-11-14T07:29:09+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/11\/deepnote-agent-initiative-benchmark-proactive-ai-agents-title.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1344\" \/>\n\t<meta property=\"og:image:height\" content=\"768\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Christopher Ort\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/i10x-news-og-default-1200x630-1.png\" \/>\n<meta name=\"twitter:creator\" content=\"@i10x_ai\" \/>\n<meta name=\"twitter:site\" content=\"@i10x_ai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Christopher Ort\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"9 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents\"},\"author\":{\"name\":\"Christopher Ort\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/person\\\/d410bb7ee72febefca2c9c369939219a\"},\"headline\":\"Agent Initiative Benchmark: GPT-6 Astra Leads, and Most AI Agents Can&#8217;t Stay Quiet\",\"datePublished\":\"2026-11-14T07:29:09+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents\"},\"wordCount\":1819,\"publisher\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents-title.webp\",\"articleSection\":[\"Agents\",\"Anthropic\",\"Models\",\"Open AI\"],\"inLanguage\":\"en-US\",\"dateModified\":\"2026-11-14T07:29:09+00:00\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents\",\"url\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents\",\"name\":\"Agent Initiative Benchmark: GPT-6 Astra Tops 12 Models - i10X News\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents-title.webp\",\"datePublished\":\"2026-11-14T07:29:09+00:00\",\"description\":\"Deepnote's Agent Initiative Benchmark tested 12 models in a synthetic company's Slack. GPT-6 Astra led at 8.97\\\/10; most models struggled to stay quiet.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents#primaryimage\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents-title.webp\",\"contentUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents-title.webp\",\"width\":1344,\"height\":768,\"caption\":\"Image: AI-generated, i10X\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/deepnote-agent-initiative-benchmark-proactive-ai-agents#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/i10x.ai\\\/news\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Agent Initiative Benchmark: GPT-6 Astra Leads, and Most AI Agents Can&#8217;t Stay Quiet\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#website\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\",\"name\":\"i10X News\",\"description\":\"Stay updated with the latest news and announcements from i10X.\",\"publisher\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/i10x.ai\\\/news?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\",\"name\":\"i10X\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/i10x-logo-180.png\",\"contentUrl\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/i10x-logo-180.png\",\"width\":180,\"height\":180,\"caption\":\"i10X\"},\"image\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/i10x_ai\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/i10x-ai\",\"https:\\\/\\\/instagram.com\\\/i10x.ai\",\"https:\\\/\\\/www.youtube.com\\\/@i10X_ai_official\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#\\\/schema\\\/person\\\/d410bb7ee72febefca2c9c369939219a\",\"name\":\"Christopher Ort\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"contentUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"caption\":\"Christopher Ort\"},\"description\":\"Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU). He is the author of \u201cThe Style Penalty\u201d, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/author\\\/christopher-ort\",\"sameAs\":[\"https:\\\/\\\/i10x.ai\\\/blog\\\/author\\\/christopher-ort\"],\"worksFor\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\"},\"alumniOf\":{\"@type\":\"EducationalOrganization\",\"name\":\"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU)\",\"url\":\"https:\\\/\\\/www.fau.eu\"},\"subjectOf\":[{\"@type\":\"CreativeWork\",\"url\":\"https:\\\/\\\/papers.ssrn.com\\\/abstract=7426699\",\"name\":\"The Style Penalty: How AI Resume-Writing Tools Shape Outcomes in Automated Hiring Screens\"},{\"@type\":\"CreativeWork\",\"url\":\"https:\\\/\\\/www.heise.de\\\/news\\\/KI-Chatbots-bewerten-KI-Lebenslaeufe-Claude-findet-sich-besser-als-GPT-11317531.html\",\"name\":\"KI-Chatbots bewerten KI-Lebensl\u00e4ufe: Claude findet sich besser als GPT\"},{\"@type\":\"CreativeWork\",\"url\":\"https:\\\/\\\/t3n.de\\\/news\\\/bewerbung-schreiben-ki-5-fehler-1747190\\\/\",\"name\":\"Bewerbung mit KI schreiben: Diese 5 Fehler solltet ihr laut Studien vermeiden\"}]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Agent Initiative Benchmark: GPT-6 Astra Tops 12 Models - i10X News","description":"Deepnote's Agent Initiative Benchmark tested 12 models in a synthetic company's Slack. GPT-6 Astra led at 8.97\/10; most models struggled to stay quiet.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents","og_locale":"en_US","og_type":"article","og_title":"Agent Initiative Benchmark: GPT-6 Astra Tops 12 Models - i10X News","og_description":"Deepnote's Agent Initiative Benchmark tested 12 models in a synthetic company's Slack. GPT-6 Astra led at 8.97\/10; most models struggled to stay quiet.","og_url":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents","og_site_name":"i10X News","article_published_time":"2026-11-14T07:29:09+00:00","og_image":[{"width":1344,"height":768,"url":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/11\/deepnote-agent-initiative-benchmark-proactive-ai-agents-title.webp","type":"image\/webp"}],"author":"Christopher Ort","twitter_card":"summary_large_image","twitter_image":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/i10x-news-og-default-1200x630-1.png","twitter_creator":"@i10x_ai","twitter_site":"@i10x_ai","twitter_misc":{"Written by":"Christopher Ort","Est. reading time":"9 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents#article","isPartOf":{"@id":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents"},"author":{"name":"Christopher Ort","@id":"https:\/\/i10x.ai\/news\/#\/schema\/person\/d410bb7ee72febefca2c9c369939219a"},"headline":"Agent Initiative Benchmark: GPT-6 Astra Leads, and Most AI Agents Can&#8217;t Stay Quiet","datePublished":"2026-11-14T07:29:09+00:00","mainEntityOfPage":{"@id":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents"},"wordCount":1819,"publisher":{"@id":"https:\/\/i10x.ai\/news\/#organization"},"image":{"@id":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents#primaryimage"},"thumbnailUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/deepnote-agent-initiative-benchmark-proactive-ai-agents-title.webp","articleSection":["Agents","Anthropic","Models","Open AI"],"inLanguage":"en-US","dateModified":"2026-11-14T07:29:09+00:00"},{"@type":"WebPage","@id":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents","url":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents","name":"Agent Initiative Benchmark: GPT-6 Astra Tops 12 Models - i10X News","isPartOf":{"@id":"https:\/\/i10x.ai\/news\/#website"},"primaryImageOfPage":{"@id":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents#primaryimage"},"image":{"@id":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents#primaryimage"},"thumbnailUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/deepnote-agent-initiative-benchmark-proactive-ai-agents-title.webp","datePublished":"2026-11-14T07:29:09+00:00","description":"Deepnote's Agent Initiative Benchmark tested 12 models in a synthetic company's Slack. GPT-6 Astra led at 8.97\/10; most models struggled to stay quiet.","breadcrumb":{"@id":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents#primaryimage","url":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/deepnote-agent-initiative-benchmark-proactive-ai-agents-title.webp","contentUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/11\/deepnote-agent-initiative-benchmark-proactive-ai-agents-title.webp","width":1344,"height":768,"caption":"Image: AI-generated, i10X"},{"@type":"BreadcrumbList","@id":"https:\/\/i10xnews.kinsta.cloud\/deepnote-agent-initiative-benchmark-proactive-ai-agents#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/i10x.ai\/news"},{"@type":"ListItem","position":2,"name":"Agent Initiative Benchmark: GPT-6 Astra Leads, and Most AI Agents Can&#8217;t Stay Quiet"}]},{"@type":"WebSite","@id":"https:\/\/i10x.ai\/news\/#website","url":"https:\/\/i10x.ai\/news","name":"i10X News","description":"Stay updated with the latest news and announcements from i10X.","publisher":{"@id":"https:\/\/i10x.ai\/news\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/i10x.ai\/news?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/i10x.ai\/news\/#organization","name":"i10X","url":"https:\/\/i10x.ai\/news\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10x.ai\/news\/#\/schema\/logo\/image\/","url":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/10\/i10x-logo-180.png","contentUrl":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/10\/i10x-logo-180.png","width":180,"height":180,"caption":"i10X"},"image":{"@id":"https:\/\/i10x.ai\/news\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/i10x_ai","https:\/\/www.linkedin.com\/company\/i10x-ai","https:\/\/instagram.com\/i10x.ai","https:\/\/www.youtube.com\/@i10X_ai_official"]},{"@type":"Person","@id":"https:\/\/i10x.ai\/news\/#\/schema\/person\/d410bb7ee72febefca2c9c369939219a","name":"Christopher Ort","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","url":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","contentUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","caption":"Christopher Ort"},"description":"Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU). He is the author of \u201cThe Style Penalty\u201d, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.","url":"https:\/\/i10x.ai\/news\/author\/christopher-ort","sameAs":["https:\/\/i10x.ai\/blog\/author\/christopher-ort"],"worksFor":{"@id":"https:\/\/i10x.ai\/news\/#organization"},"alumniOf":{"@type":"EducationalOrganization","name":"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU)","url":"https:\/\/www.fau.eu"},"subjectOf":[{"@type":"CreativeWork","url":"https:\/\/papers.ssrn.com\/abstract=7426699","name":"The Style Penalty: How AI Resume-Writing Tools Shape Outcomes in Automated Hiring Screens"},{"@type":"CreativeWork","url":"https:\/\/www.heise.de\/news\/KI-Chatbots-bewerten-KI-Lebenslaeufe-Claude-findet-sich-besser-als-GPT-11317531.html","name":"KI-Chatbots bewerten KI-Lebensl\u00e4ufe: Claude findet sich besser als GPT"},{"@type":"CreativeWork","url":"https:\/\/t3n.de\/news\/bewerbung-schreiben-ki-5-fehler-1747190\/","name":"Bewerbung mit KI schreiben: Diese 5 Fehler solltet ihr laut Studien vermeiden"}]}]}},"_links":{"self":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/8935","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/comments?post=8935"}],"version-history":[{"count":0,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/8935\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/media\/8934"}],"wp:attachment":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/media?parent=8935"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/categories?post=8935"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/tags?post=8935"},{"taxonomy":"company","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/companies?post=8935"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/products?post=8935"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}