AI Infrastructure
AI infrastructure is the compute, networking, and software used to train and serve models.
Follow training and inference stacks from cluster scheduling and networks to model serving. Coverage focuses on deployment, throughput, reliability, and operating cost.
Latest coverage
Articles
NewsAWS adds in-region Claude 5 inference in Seoul and Singapore
NewsNscale says $2.6 billion of its $103.4 billion contract total is active
NewsTogether AI adds live tracking and finer controls to fine-tuning
NewsGoogle DeepMind lays out planned server-side memory for Private AI Compute
NewsCrusoe and Perplexity sign multi-year AI cloud partnership
NewsTogether AI adds canary rollouts for production model upgrades
NewsBiological Computing Company plans neuron-derived AI rollout on AWS
NewsPositron arrives on Amazon SageMaker AI in public preview
NewsDatabricks details Proteus harness for shape-specialized GPU kernels
NewsAWS releases six open-source Hugging Face deployment skills for SageMaker
NewsAWS launches GPU-aware routing for SageMaker HyperPod
NewsIBM and Red Hat deploy GLM-5.2 on 544 H100 GPUs with llm-d