Section
Infrastructure – Page 20
The latest Infrastructure news, analysed daily by the i10X newsroom.
FilterCompanies & models
More stories
-

AWS Activates Project Rainier: $11B AI Campus with Trainium2
AWS launches Project Rainier, an $11B gigawatt-scale AI campus in Indiana powered by 500,000+ Trainium2 chips. Discover how this vertically integrated facility with Anthropic challenges NVIDIA…
-

Nvidia Licenses Groq LPU: License-and-Hire Insights
Discover Nvidia’s non-exclusive licensing of Groq’s LPU tech for AI inference, plus key hires, debunking $20B buyout rumors. Explore impacts on AI hardware, developers, and market…
-

AWS Mantle: Zero Operator Access for Bedrock Security
Discover AWS Mantle’s Zero Operator Access (ZOA) architecture for Amazon Bedrock, eliminating operator access to sensitive AI data. Learn how this enhances security and compliance for…
-

KV Cache in LLMs: Boosting Inference Efficiency
Explore the role of KV caching in large language models, its memory challenges, and key optimizations like PagedAttention and GQA. Learn how to scale LLM inference…
-

AI Governance: From Ethics to Engineering Trust
Explore the shift in AI governance from ethical debates to practical engineering challenges. Learn how Governance-as-Code enables scalable safeguards, compliance with ISO/IEC 42001 and NIST RMF,…
-

TwelveLabs Marengo: Video AI Embeddings on AWS Bedrock
Discover how TwelveLabs’ Marengo 3.0 multimodal embeddings integrate with Amazon Bedrock to enable semantic video search and RAG for video. Unlock value from video archives for…
-

OpenAI’s Stargate AI Campus in Sydney: Key Insights
Explore OpenAI’s $4.6B partnership with NEXTDC to build a massive Stargate AI supercomputing facility in Sydney. Discover impacts on AI infrastructure, energy demands, and sovereign AI…
-

Offline AI PCs: Boosting Privacy and Performance in Enterprises
Explore the shift to AI PCs with NPUs for on-device processing, enhancing data privacy, cutting cloud costs, and reducing latency. Learn the benefits, challenges, and impacts…
-

Gemini 3 Pro Limits: Navigating Access Quotas
Discover the fragmented rate limits and quotas for Gemini 3 Pro across APIs, consumer apps, and free tiers. Learn why these restrictions exist, their impact on…
-

OpenAI Oracle Deal: $300B Stargate AI Infrastructure Push
Explore the OpenAI-Oracle partnership, a $300 billion deal fueling the Stargate supercomputer with 4.5 GW of power. Uncover impacts on AI development, stakeholders, and the energy…
-

OpenAI’s Two-Front Hardware Push: Accelerators & Devices
Explore OpenAI’s strategic hardware initiatives, from custom AI accelerators with Broadcom and AMD to Jony Ive’s AI-native consumer devices. Understand the impacts on NVIDIA, costs, and…
-

OpenAI & Foxconn: Co-Designing Next-Gen AI Data Center Hardware
OpenAI partners with Foxconn to co-design and manufacture custom AI data center hardware in the US, tackling power and cooling challenges for advanced AI models. Gain…