A Whirlwind Tour of ML Model Serving Strategies (Including LLMs)
There are many recipes to serve machine learning models to end users today, and even though new ways keep popping up as time passes, some questions remain: How do we pick the appropriate serving recipe from the menu we have available, and how can we execute it as fast and efficiently as possible? In this talk, we’re going to go through a whirlwind tour of the different machine learning deployment strategies available today for both traditional ML systems and Large Language Models, and we
A whirlwind tour of machine learning model serving strategies for both traditional ML systems and Large Language Models, covering how to choose the right deployment recipe and execute it as fast and efficiently as possible.
More from the studio
1:01:41SF DEMO NIGHT 🚀 (w/ The AI Collective)
Six startup teams present live AI demos spanning interactive avatars, executive communication, home services, autonomous-agent security, enterprise operations, and personal intelligence, followed by audience Q&A and community voting.
Dmytro Spodarets·Sep 18, 2026
17:58Interview with Keerti Melkote: Anyscale Azure Integration and the Future of Ray
At Ray Summit 2025, Dmytro Spodarets speaks with Keerti Melkote about Anyscale, Ray, and the new Azure integration. The interview covers enterprise AI workloads, GPU challenges, agentic systems, and the future of scalable AI infrastructure.
Dmytro Spodarets·Nov 24, 2025
38:39Manus vs OpenAI: How a Startup Is Beating the Giants in the AI Agent Race
Tao Zhang of Manus AI shares how the startup is taking on OpenAI in the agent race, revealing product insights, strategy, and the future of intelligent tools.
Dmytro Spodarets·Jul 21, 2025