AI Infrastructure
AI infrastructure is the compute, networking, and software used to train and serve models.
Follow training and inference stacks from cluster scheduling and networks to model serving. Coverage focuses on deployment, throughput, reliability, and operating cost.
Latest coverage
Articles
NewsDatabricks plans AWS and Azure sovereign-cloud expansion in Europe
NewsSnowflake puts Cortex Training into public preview
NewsAWS adds India-only Kimi K3 inference profile to Bedrock
NewsMicrosoft puts Cobalt 200 VMs to work on chip design
NewsTogether AI launches self-tuning compiler for open-model inference
NewsAnthropic discloses $895.4 billion in compute commitments
NewsCohere commits more than C$4 billion to Canadian AI expansion
NewsGoogle’s Project Suncatcher returns its first AI response from orbit
NewsAMD and Oracle plan EPYC-powered OCI E7 instances and Pensando networking
NewsOracle, Cerebras target 2027 for OCI inference service
NewsAMD says Helios systems are under test at Meta, commits $1 billion
NewsNVIDIA and Meta deepen Muse collaboration on training and inference
Videos
53:56MLOps for Ads Ranking at Pinteres
Dmytro Spodarets·Nov 3, 2023
36:11Reducing NLP Inference costs through model specialisation
Dmytro Spodarets·Jul 10, 2023
59:31Webinar "dstack – a command-line utility to provision infrastructure for ML workflows"
Dmytro Spodarets·Mar 2, 2023
37:39Webinar "Vertex AI Pipelines infrastructure with Terraform"
Dmytro Spodarets·Mar 2, 2023
0:00Webinar "Deploying DL models with Kubernetes and Kubeflow"
Dmytro Spodarets·Oct 3, 2022
0:00Webinar "Pachyderm in production: lessons learned" (RU)
Dmytro Spodarets·Oct 1, 2021
1:08:33Webinar "From research to product with Hydrosphere" (RU)
Dmytro Spodarets·Sep 24, 2021
55:46Webinar "Re-usable pipelines for ML projects with DVC" (RU)
Dmytro Spodarets·Sep 17, 2021
1:20:54Webinar "Deploying deep learning models with Kubernetes and Kubeflow" (RU)
Dmytro Spodarets·Sep 10, 2021