AI Infrastructure
AI infrastructure is the compute, networking, and software used to train and serve models.
Follow training and inference stacks from cluster scheduling and networks to model serving. Coverage focuses on deployment, throughput, reliability, and operating cost.
Latest coverage
Articles
NewsMosaicML Inference: Secure, Private, and Affordable Deployment for Large Models
NewsGoogle's A3 supercomputer VMs
NewsRay 2.4.0: Infrastructure for LLM training, tuning, inference, and serving
Newsdstack 0.8: Local Hub, Hugging Face integration, and more
NewsNew NVIDIA computing platforms for large language models and generative AI workloads
NewsThe next-generation release of PyTorch 2.0 surprises with more speed, pythonization, and dynamism
NewsNVIDIA launches DGX Cloud - the ability to instantly access the AI supercomputer from a browser
NewsOpenAI’s Foundry will let customers buy dedicated compute to run its AI models
ArticleBringing GitOps to ML with dstack
NewsBest practices for building machine learning platforms on the cloud
NewsColab's ‘Pay As You Go’ Offers More Access to Powerful NVIDIA Compute for Machine Learning
ArticleMLOps in 10 Minutes