Evaluating LLM Models for Production Systems: Methods and Practices
During this talk, we will discuss a comprehensive understanding of the evaluation processes for LLMs, particularly in the context of preparing these models for deployment in production environments.
This webinar is designed to offer a comprehensive understanding of the evaluation processes for LLMs, particularly in the context of preparing these models for deployment in production environments.
Key Highlights of the webinar:
- In-Depth Analysis of LLM Evaluation Methods: Gain insights into a variety of methods to evaluate LLM models, understanding their strengths and weaknesses.
- End-to-End Evaluation Techniques: Explore how LLM augmented systems are assessed from a holistic perspective.
- Pragmatic Approach to System Deployment: Learn practical strategies for applying these evaluation techniques to systems intended for real-world application.
- Focused Overview on Critical LLM Aspects: Receive an overview of various evaluation techniques that are essential for assessing the most crucial elements of modern LLM systems.
- Simplifying the Evaluation Process: Understand how to streamline the evaluation process, making the work of LLM scientists more efficient and productive.
Speaker
Dr. Andrei Lopatenko is a seasoned expert and executive leader with over 15 years of experience in the tech industry, focusing on search engines, recommendation systems, and large-scale AI, ML, and NLP applications. He has contributed significantly to major companies like Google, Apple, Walmart, eBay, and Zillow, benefiting billions of customers. Dr. Lopatenko earned his PhD in Computer Science from the University of Manchester. He played a key role in developing Google's search engine, initiating Apple Maps, co-founding a Conversational AI startup acquired by Facebook/Meta, and leading Search, LLM, and Generative AI at Zillow.
