AI Infrastructure
AI infrastructure is the compute, networking, and software used to train and serve models.
Follow training and inference stacks from cluster scheduling and networks to model serving. Coverage focuses on deployment, throughput, reliability, and operating cost.
Latest coverage
Articles
NewsTogether AI launches managed post-training service for open models
NewsScale opens Nemotron post-training service to enterprises
NewsAWS releases MoE inference changes for SageMaker LMI and vLLM
NewsDatabricks says kernels and packing cut Qwen fine-tuning time sixfold
NewsDatabricks details AI Runtime workflow for agent-led model research
NewsTogether AI adds Muse Spark Open to serverless and dedicated infrastructure
NewsApple adds MLX distributed inference across Mac Studio systems
NewsNVIDIA opens AI tools, training and compute access to European researchers
NewsGartner says $3.5 trillion in AI infrastructure spending could face impairment
NewsNVIDIA commits compute access valued at $250 million to UK AI safety research
NewsMicrosoft denies Azure cost-cutting directive after reported 20% request
NewsAMD says Helios production is ramping with initial systems running