AI Infrastructure
AI infrastructure is the compute, networking, and software used to train and serve models.
Follow training and inference stacks from cluster scheduling and networks to model serving. Coverage focuses on deployment, throughput, reliability, and operating cost.
Latest coverage
Articles
NewsNVIDIA unveils Nemotron science stack and Nsight porting agent
NewsNVIDIA Introduces Four-Node DGX Spark HPC Developer Kit
NewsNVIDIA Specifies 192-CPU Vera Rack for Scientific Computing
NewsAMD introduces open-source HPC Assistant at SC26
NewsAMD-powered Lux supercomputer opens to Oak Ridge researchers
NewsLambda deploys NVIDIA Photonics switches across 10,000-plus GPUs
NewsBaidu revenue falls 1% as it reports 94% AI cloud sales growth
NewsAssemblyAI runs speech inference on EC2 Spot GPUs with queued retries
NewsMicrosoft winds down Oracle AI cloud capacity deal
NewsNVIDIA releases Dynamo deployment recipes for four Korean open models
NewsGoogle makes Agent Substrate 1.0 generally available on GKE
NewsAWS adds GPU partitioning to SageMaker Inference
Videos
TechCrunch Disrupt 2026 · AIEEV
Oct 22, 2026
1:00:23Tech TalksFrom Prototype to Production: The Hidden Engineering of AI Inference
17:58Interview with Keerti Melkote: Anyscale Azure Integration and the Future of Ray
Dmytro Spodarets·Nov 24, 2025
53:04Dmytro Spodarets Podcast #1: AI Agents, Scalr, OpenTofu, DevOps tools, MLOps, LLMops
Dmytro Spodarets·Apr 15, 2025
1:02:32Accelerating Generative AI with HPE: From Development to Deployment
Dmytro Spodarets·Oct 28, 2024
50:18Exploring Infrastructure Management for GenAI Beyond Kubernetes
Dmytro Spodarets·Mar 15, 2024
55:03A Whirlwind Tour of ML Model Serving Strategies (Including LLMs)
Dmytro Spodarets·Jan 29, 2024
1:07:35Democratizing AI Deployment
Dmytro Spodarets·Dec 18, 2023
1:10:29Leveraging open-source LLMs for production
Dmytro Spodarets·Dec 4, 2023