{"id":2406,"date":"2026-05-01T07:29:46","date_gmt":"2026-05-01T07:29:46","guid":{"rendered":"https:\/\/i10xnews.kinsta.cloud\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference"},"modified":"2026-05-01T07:29:46","modified_gmt":"2026-05-01T07:29:46","slug":"flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference","status":"publish","type":"post","link":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference","title":{"rendered":"FlashKDA: Moonshot AI&#8217;s Open-Source CUDA Kernels for LLM Speed"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">\u26a1 Quick Take<\/h2>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">Moonshot AI, the folks behind the Kimi LLM, just open-sourced <strong>FlashKDA<\/strong>\u2014a collection of high-performance CUDA kernels tailored to speed up their custom &#8220;Delta Attention&#8221; mechanism. By zeroing in on the gritty details of GPU work with CUTLASS and supporting variable-length batching, this isn&#8217;t merely an tweak; it&#8217;s a bold pushback against the generic setups in libraries like FlashAttention. It hints at a shift, where unique model designs call for their own open-source hardware boosts, right down to the code level.<\/p>\n<\/blockquote>\n\n\n\n<h3 class=\"wp-block-heading\">What happened<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Picture this: Moonshot AI, a heavyweight in China&#8217;s LLM world, drops <strong>FlashKDA<\/strong> as an open-source gem. It&#8217;s their low-level take on the &#8220;Kimi Delta Attention&#8221; algorithm, pieced together with NVIDIA&#8217;s CUTLASS library to squeeze every bit of speed from GPUs. The big draws? Serious gains in LLM decoding speed and smarter GPU use, thanks to built-in handling for batches of varying lengths\u2014no more one-size-fits-all padding headaches.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Why it matters now<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Have you felt the pinch of LLM inference costs holding back your deployments? That&#8217;s the reality we&#8217;re in, where efficiency battles aren&#8217;t just about clever model designs anymore\u2014they drill down into the software&#8217;s core. <strong>FlashKDA<\/strong> steps up by fine-tuning a specialized attention setup, showing how custom kernels might edge out the ease of go-to options like FlashAttention or xFormers when raw performance counts.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Who is most affected<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">For LLM inference engineers and those knee-deep in CUDA or GPU coding, this lands like a fresh toolkit for cutting throughput delays and latency. AI researchers get a solid, speedy way to tinker with new attention ideas. And for the teams behind rival libraries, say FlashAttention&#8217;s creators, it&#8217;s a wake-up call\u2014a niche rival that tests whether broad tools can keep pace without sacrificing speed.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">The under-reported angle<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">But here&#8217;s the thing: this goes deeper than one more quick kernel. It&#8217;s part of a bigger splintering in the AI acceleration world. With labs building unique edges\u2014like Kimi&#8217;s Delta Attention\u2014they&#8217;re compelled to share custom kernels openly, fostering ecosystems and pulling in users. That could scatter the field, leaving developers juggling a mix of targeted, hardware-tuned pieces instead of leaning on that one trusty layer. Plenty to think about there, really.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83e\udde0 Deep Dive<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Ever wonder what pushes LLM performance to the edge in real-world setups? Moonshot AI&#8217;s <strong>FlashKDA<\/strong> release isn&#8217;t some casual share\u2014it&#8217;s a clear signal that the real gains hide in those CUDA trenches. Drawing on NVIDIA&#8217;s CUTLASS for crafting top-tier matrix-multiplication kernels, <strong>FlashKDA<\/strong> zeros in on accelerating <strong>Kimi Delta Attention<\/strong>, the heart of their long-context Kimi chatbot. By making the guts open-source, Moonshot&#8217;s essentially handing the reins to developers worldwide\u2014not just to run it, but to poke, test, and refine what drives their model&#8217;s edge. From what I&#8217;ve seen in similar drops, that kind of openness can spark real momentum.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The standout bit for live production? Its native grip on <strong>variable-length batching<\/strong>. In the thick of serving LLMs, user queries hit with all sorts of sequence lengths\u2014short quips next to rambling essays. Padding everything to match? It&#8217;s a clunky fix that burns GPU cycles and memory for nothing. <strong>FlashKDA<\/strong> sidesteps that mess, letting the hardware chew through uneven batches straight-up. The payoff: smoother throughput, less wasted compute, and\u2014crucially\u2014a drop in those inference costs per token. Weighing the upsides, it feels like a practical win for scaling without the usual trade-offs.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That said, benchmarks tell the tale, don&#8217;t they? Moonshot&#8217;s shared their H20 results, flaunting speed edges, but independent checks are where the rubber meets the road. The community\u2014us engineers, anyway\u2014is itching for fair fights: <strong>FlashKDA<\/strong> versus FlashAttention (v2, v3) or NVIDIA&#8217;s Triton, all on the same gear like A100s or H100s. We&#8217;ll need those throughput and latency graphs across lengths, batch sizes, hardware flavors to gauge the true bite. The release sets the stage nicely, leaving room for just that kind of scrutiny.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Adoption-wise, though, speed alone won&#8217;t cut it\u2014it&#8217;s about how smoothly it fits into the daily grind. A kernel&#8217;s great on GitHub, but in production? That&#8217;s another story. What&#8217;ll make or break <strong>FlashKDA<\/strong> is the docs&#8217; depth, API examples that click without frustration, and plug-and-play vibes with stacks like PyTorch, TensorRT, or vLLM. Skip the solid guides, compatibility charts for GPUs and drivers, or a clear path forward, and even a speed demon risks gathering dust\u2014useful only to the CUDA wizards among us. It&#8217;s a reminder: tools thrive on usability, not just horsepower.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udcca Stakeholders &amp; Impact<\/h2>\n\n\n<ul class=\"wp-block-list\"><li><strong>LLM Inference Providers<\/strong> \u2014 Impact: High; Insight: Provides a new, potentially superior tool for reducing latency and cost-per-token, especially for models using non-standard attention.<\/li><li><strong>GPU \/ CUDA Developers<\/strong> \u2014 Impact: High; Insight: Offers a concrete example of advanced kernel optimization using CUTLASS and a new open-source project to contribute to or learn from.<\/li><li><strong>Competing Optimization Libraries (FlashAttention)<\/strong> \u2014 Impact: Significant; Insight: Introduces a specialized competitor, challenging their dominance and pushing them to prove their generality is not a performance compromise.<\/li><li><strong>AI Model Researchers<\/strong> \u2014 Impact: Medium; Insight: Enables performant experimentation with Delta Attention and similar sparse or alternative attention mechanisms.<\/li><\/ul>\n\n\n<h2 class=\"wp-block-heading\">\u270d\ufe0f About the analysis<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">This analysis is an independent i10x review based on the technical details of the <strong>FlashKDA<\/strong> open-source release and the common pain points in LLM inference optimization. It synthesizes publicly available information and an evaluation of current content gaps to frame the development for AI engineers, infrastructure architects, and technology leaders tracking the AI hardware and software ecosystem.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\ud83d\udd2d i10x Perspective<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">I&#8217;ve noticed how releases like <strong>FlashKDA<\/strong> capture the unraveling of the AI stack&#8217;s old monoliths. With everyone racing for standout architectures, we&#8217;re leaving behind the days when one library\u2014think FlashAttention\u2014could handle it all. Ahead lies a patchwork world, hyper-tuned and specialized, where models come bundled with their custom, open-source kernels for acceleration.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This sparks a fresh rivalry: who nails the slickest, hardware-smart build for those innovative bits? For outfits like Moonshot, sharing these kernels openly turns into a must-do, building buzz and user bases. The lingering question\u2014 one that keeps me up sometimes\u2014is if this splintering fuels breakthroughs through focus, or bogs things down with extra layers for the folks wiring it all together. Either way, <strong>it&#8217;s reshaping how we build these smart systems.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Discover Moonshot AI&#8217;s FlashKDA, a high-performance open-source toolkit using CUTLASS for accelerating Kimi Delta Attention. Achieve faster LLM decoding with variable-length batching, reducing inference costs. Explore the impact on AI efficiency.<\/p>\n","protected":false},"author":2,"featured_media":2404,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"paper_title":"","paper_url":"","pdf_url":"","doi":"","arxiv_id":"","authors":"","institutions":"","paper_date":"","venue":"","peer_reviewed":false,"code_url":"","data_url":"","funding_coi":"","figure_license":"","paper_license":"","replication":"","study_models":"","study_sample":"","footnotes":"","_yoast_wpseo_primary_category":""},"categories":[11,9,27],"tags":[],"companies":[47],"products":[],"class_list":["post-2406","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-infrastructure","category-models","category-moonshot","company-moonshot"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>FlashKDA: Moonshot AI&#039;s Open-Source CUDA Kernels for LLM Speed - i10X News<\/title>\n<meta name=\"description\" content=\"Discover Moonshot AI&#039;s FlashKDA, a high-performance open-source toolkit using CUTLASS for accelerating Kimi Delta Attention.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"FlashKDA: Moonshot AI&#039;s Open-Source CUDA Kernels for LLM Speed - i10X News\" \/>\n<meta property=\"og:description\" content=\"Discover Moonshot AI&#039;s FlashKDA, a high-performance open-source toolkit using CUTLASS for accelerating Kimi Delta Attention.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference\" \/>\n<meta property=\"og:site_name\" content=\"i10X News\" \/>\n<meta property=\"article:published_time\" content=\"2026-05-01T07:29:46+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/flashkda-moonshot-ai-kernels.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1344\" \/>\n\t<meta property=\"og:image:height\" content=\"768\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Christopher Ort\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@i10x_ai\" \/>\n<meta name=\"twitter:site\" content=\"@i10x_ai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Christopher Ort\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference\"},\"author\":{\"name\":\"Christopher Ort\",\"@id\":\"https:\\\/\\\/news.i10x.ai\\\/#\\\/schema\\\/person\\\/d410bb7ee72febefca2c9c369939219a\"},\"headline\":\"FlashKDA: Moonshot AI&#8217;s Open-Source CUDA Kernels for LLM Speed\",\"datePublished\":\"2026-05-01T07:29:46+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference\"},\"wordCount\":1078,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/news.i10x.ai\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/flashkda-moonshot-ai-kernels.webp\",\"articleSection\":[\"Infrastructure\",\"Models\",\"Moonshot\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#respond\"]}],\"dateModified\":\"2026-05-01T07:29:46+00:00\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference\",\"name\":\"FlashKDA: Moonshot AI's Open-Source CUDA Kernels for LLM Speed - i10X News\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/news.i10x.ai\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/flashkda-moonshot-ai-kernels.webp\",\"datePublished\":\"2026-05-01T07:29:46+00:00\",\"description\":\"Discover Moonshot AI's FlashKDA, a high-performance open-source toolkit using CUTLASS for accelerating Kimi Delta Attention.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#primaryimage\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/flashkda-moonshot-ai-kernels.webp\",\"contentUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/flashkda-moonshot-ai-kernels.webp\",\"width\":1344,\"height\":768,\"caption\":\"Abstract visualization of a glowing sphere with orbiting rings and particles, representing AI and data processing.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/news.i10x.ai\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"FlashKDA: Moonshot AI&#8217;s Open-Source CUDA Kernels for LLM Speed\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/news.i10x.ai\\\/#website\",\"url\":\"https:\\\/\\\/news.i10x.ai\\\/\",\"name\":\"i10X News\",\"description\":\"Stay updated with the latest news and announcements from i10X.\",\"publisher\":{\"@id\":\"https:\\\/\\\/news.i10x.ai\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/news.i10x.ai\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/news.i10x.ai\\\/#organization\",\"name\":\"i10X\",\"url\":\"https:\\\/\\\/news.i10x.ai\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/news.i10x.ai\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/i10x-logo-180.png\",\"contentUrl\":\"https:\\\/\\\/i10xnews.kinsta.cloud\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/i10x-logo-180.png\",\"width\":180,\"height\":180,\"caption\":\"i10X\"},\"image\":{\"@id\":\"https:\\\/\\\/news.i10x.ai\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/i10x_ai\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/i10x-ai\",\"https:\\\/\\\/instagram.com\\\/i10x.ai\",\"https:\\\/\\\/www.youtube.com\\\/@i10X_ai_official\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/news.i10x.ai\\\/#\\\/schema\\\/person\\\/d410bb7ee72febefca2c9c369939219a\",\"name\":\"Christopher Ort\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"contentUrl\":\"https:\\\/\\\/i10x.ai\\\/news\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/christopher-ort-192.webp\",\"caption\":\"Christopher Ort\"},\"description\":\"Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU). He is the author of \u201cThe Style Penalty\u201d, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.\",\"url\":\"https:\\\/\\\/i10x.ai\\\/news\\\/author\\\/christopher-ort\",\"sameAs\":[\"https:\\\/\\\/i10x.ai\\\/blog\\\/author\\\/christopher-ort\"],\"worksFor\":{\"@id\":\"https:\\\/\\\/i10x.ai\\\/news\\\/#organization\"},\"alumniOf\":{\"@type\":\"EducationalOrganization\",\"name\":\"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU)\",\"url\":\"https:\\\/\\\/www.fau.eu\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"FlashKDA: Moonshot AI's Open-Source CUDA Kernels for LLM Speed - i10X News","description":"Discover Moonshot AI's FlashKDA, a high-performance open-source toolkit using CUTLASS for accelerating Kimi Delta Attention.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference","og_locale":"en_US","og_type":"article","og_title":"FlashKDA: Moonshot AI's Open-Source CUDA Kernels for LLM Speed - i10X News","og_description":"Discover Moonshot AI's FlashKDA, a high-performance open-source toolkit using CUTLASS for accelerating Kimi Delta Attention.","og_url":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference","og_site_name":"i10X News","article_published_time":"2026-05-01T07:29:46+00:00","og_image":[{"width":1344,"height":768,"url":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/flashkda-moonshot-ai-kernels.webp","type":"image\/webp"}],"author":"Christopher Ort","twitter_card":"summary_large_image","twitter_creator":"@i10x_ai","twitter_site":"@i10x_ai","twitter_misc":{"Written by":"Christopher Ort","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#article","isPartOf":{"@id":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference"},"author":{"name":"Christopher Ort","@id":"https:\/\/news.i10x.ai\/#\/schema\/person\/d410bb7ee72febefca2c9c369939219a"},"headline":"FlashKDA: Moonshot AI&#8217;s Open-Source CUDA Kernels for LLM Speed","datePublished":"2026-05-01T07:29:46+00:00","mainEntityOfPage":{"@id":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference"},"wordCount":1078,"commentCount":0,"publisher":{"@id":"https:\/\/news.i10x.ai\/#organization"},"image":{"@id":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#primaryimage"},"thumbnailUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/flashkda-moonshot-ai-kernels.webp","articleSection":["Infrastructure","Models","Moonshot"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#respond"]}],"dateModified":"2026-05-01T07:29:46+00:00"},{"@type":"WebPage","@id":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference","url":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference","name":"FlashKDA: Moonshot AI's Open-Source CUDA Kernels for LLM Speed - i10X News","isPartOf":{"@id":"https:\/\/news.i10x.ai\/#website"},"primaryImageOfPage":{"@id":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#primaryimage"},"image":{"@id":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#primaryimage"},"thumbnailUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/flashkda-moonshot-ai-kernels.webp","datePublished":"2026-05-01T07:29:46+00:00","description":"Discover Moonshot AI's FlashKDA, a high-performance open-source toolkit using CUTLASS for accelerating Kimi Delta Attention.","breadcrumb":{"@id":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#primaryimage","url":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/flashkda-moonshot-ai-kernels.webp","contentUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/flashkda-moonshot-ai-kernels.webp","width":1344,"height":768,"caption":"Abstract visualization of a glowing sphere with orbiting rings and particles, representing AI and data processing."},{"@type":"BreadcrumbList","@id":"https:\/\/i10x.ai\/news\/flashkda-moonshot-ai-open-source-cuda-kernels-llm-inference#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/news.i10x.ai\/"},{"@type":"ListItem","position":2,"name":"FlashKDA: Moonshot AI&#8217;s Open-Source CUDA Kernels for LLM Speed"}]},{"@type":"WebSite","@id":"https:\/\/news.i10x.ai\/#website","url":"https:\/\/news.i10x.ai\/","name":"i10X News","description":"Stay updated with the latest news and announcements from i10X.","publisher":{"@id":"https:\/\/news.i10x.ai\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/news.i10x.ai\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/news.i10x.ai\/#organization","name":"i10X","url":"https:\/\/news.i10x.ai\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/news.i10x.ai\/#\/schema\/logo\/image\/","url":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/10\/i10x-logo-180.png","contentUrl":"https:\/\/i10xnews.kinsta.cloud\/wp-content\/uploads\/2026\/10\/i10x-logo-180.png","width":180,"height":180,"caption":"i10X"},"image":{"@id":"https:\/\/news.i10x.ai\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/i10x_ai","https:\/\/www.linkedin.com\/company\/i10x-ai","https:\/\/instagram.com\/i10x.ai","https:\/\/www.youtube.com\/@i10X_ai_official"]},{"@type":"Person","@id":"https:\/\/news.i10x.ai\/#\/schema\/person\/d410bb7ee72febefca2c9c369939219a","name":"Christopher Ort","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","url":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","contentUrl":"https:\/\/i10x.ai\/news\/wp-content\/uploads\/2026\/10\/christopher-ort-192.webp","caption":"Christopher Ort"},"description":"Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU). He is the author of \u201cThe Style Penalty\u201d, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.","url":"https:\/\/i10x.ai\/news\/author\/christopher-ort","sameAs":["https:\/\/i10x.ai\/blog\/author\/christopher-ort"],"worksFor":{"@id":"https:\/\/i10x.ai\/news\/#organization"},"alumniOf":{"@type":"EducationalOrganization","name":"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg (FAU)","url":"https:\/\/www.fau.eu"}}]}},"_links":{"self":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/2406","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/comments?post=2406"}],"version-history":[{"count":1,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/2406\/revisions"}],"predecessor-version":[{"id":5246,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/posts\/2406\/revisions\/5246"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/media\/2404"}],"wp:attachment":[{"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/media?parent=2406"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/categories?post=2406"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/tags?post=2406"},{"taxonomy":"company","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/companies?post=2406"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/i10x.ai\/news\/wp-json\/wp\/v2\/products?post=2406"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}