AI Infrastructure
AI infrastructure is the compute, networking, and software used to train and serve models.
Follow training and inference stacks from cluster scheduling and networks to model serving. Coverage focuses on deployment, throughput, reliability, and operating cost.
Latest coverage
Articles
- News
MLflow 2.9.0 is out
NewsAnyscale releases Ray 2.7: improvements for Ray libraries and KubeRay, introduces RayLLM
NewsNvidia announces availability of DGX Cloud on Oracle Cloud Infrastructure for generative AI training
NewsAnnouncing OpenLLM: An Open-Source Platform for Running Large Language Models in Production
NewsTitanML: Why we are launching a public beta
NewsNVIDIA-Microsoft AI Collaboration
NewsDell-NVIDIA Project Helix
NewsMosaicML Inference: Secure, Private, and Affordable Deployment for Large Models
NewsGoogle's A3 supercomputer VMs
NewsRay 2.4.0: Infrastructure for LLM training, tuning, inference, and serving
Newsdstack 0.8: Local Hub, Hugging Face integration, and more
NewsNew NVIDIA computing platforms for large language models and generative AI workloads