AI Infrastructure
AI infrastructure is the compute, networking, and software used to train and serve models.
Follow training and inference stacks from cluster scheduling and networks to model serving. Coverage focuses on deployment, throughput, reliability, and operating cost.
Latest coverage
Articles
NewsAWS adds instance preference lists to SageMaker AI jobs
Article10 Practical Ways to Train and Fine-Tune LLMs on Limited Hardware in 2026
NewsAWS brings local model caches to SageMaker HyperPod inference
NewsOpenAI says Habitat handles more than 70 million requests per second
NewsAWS documents prefix-aware routing for SageMaker real-time endpoints
NewsCohere details a megakernel serving engine for North Mini Code
NewsAWS introduces HyperPod InstantStart control plane for agent-driven cluster operations
NewsEuroHPC contract specifies AMD MI430X GPUs and EPYC CPUs for LUMI-AI
NewsAWS and NVIDIA plan to deploy two million additional GPUs by 2028
NewsMeta has quietly become one of Microsoft Azure's largest AI customers
NewsNutanix and ChronoScale partner to package agentic AI infrastructure for on-premises data
NewsAMD prices record $4.75 billion bond sale to fund AI infrastructure buildout