AI Model Evaluation
商品資訊
ISBN13：9781633435674
出版社：MANNING PUBN
作者：Leemay Nassery
出版日：2026/04/28
裝訂：平裝
定價
：NT$ 3000 元預購中
下單可得紅利積點：90 點
商品簡介
商品簡介
De-risk AI models, validate real-world performance, and align output with product goals. Before you trust critical business systems to an AI model, you need to answer a few questions. Will it be fast enough? Will the system satisfy user expectations? Is it safe? Can you trust the output? This book will help you answer these questions and more before you roll out an AI system--and make sure it runs smoothly after you deploy. In AI Model Evaluation you'll learn how to: - Build diagnostic offline evaluations that uncover model behavior
- Use shadow traffic to simulate production conditions
- Design A/B tests that validate model impact on key product metrics
- Spot nuanced failures with human-in-the-loop feedback
- Use LLMs as automated judges to scale your evaluation pipeline In AI Model Evaluation author Leemay Nassery shares her hard-won experiences specializing in experimentation and personalization across companies such as Spotify, Comcast, Dropbox, and Etsy. The book is packed with insights on what it really takes to get a model ready for production. You'll go beyond basic performance evaluations to discover how you can measure model effectiveness on the product, spot latency issues as you introduce the model in your end-to-end architecture, and understand the model's real-world impact. About the book AI Model Evaluation teaches you how to effectively evaluate and assess machine learning models for better scaling and integration into production systems. Each chapter tackles a different evaluation method. You'll start with offline evaluations, then move into live A/B tests, shadow traffic deployments, qualitative evaluations, and LLM-based feedback loops. You'll learn how to evaluate both model behavior and engineering system performance, with a hands-on example grounded in a movie recommendation engine. About the reader For practitioners with experience in machine learning, data science, or software engineering. Familiarity with Python is recommended. About the author Leemay Nassery is an engineering leader specializing in experimentation and personalization. With a notable track record that includes evolving Spotify's A/B testing strategy for the Homepage, launching Comcast's For You page, and establishing data warehousing teams at Etsy, she firmly believes that the key to innovation at any company is the ability to experiment effectively. Get a free eBook (PDF or ePub) from Manning as well as access to the online liveBook format (and its AI assistant that will answer your questions in any language) when you purchase the print book.
- Use shadow traffic to simulate production conditions
- Design A/B tests that validate model impact on key product metrics
- Spot nuanced failures with human-in-the-loop feedback
- Use LLMs as automated judges to scale your evaluation pipeline In AI Model Evaluation author Leemay Nassery shares her hard-won experiences specializing in experimentation and personalization across companies such as Spotify, Comcast, Dropbox, and Etsy. The book is packed with insights on what it really takes to get a model ready for production. You'll go beyond basic performance evaluations to discover how you can measure model effectiveness on the product, spot latency issues as you introduce the model in your end-to-end architecture, and understand the model's real-world impact. About the book AI Model Evaluation teaches you how to effectively evaluate and assess machine learning models for better scaling and integration into production systems. Each chapter tackles a different evaluation method. You'll start with offline evaluations, then move into live A/B tests, shadow traffic deployments, qualitative evaluations, and LLM-based feedback loops. You'll learn how to evaluate both model behavior and engineering system performance, with a hands-on example grounded in a movie recommendation engine. About the reader For practitioners with experience in machine learning, data science, or software engineering. Familiarity with Python is recommended. About the author Leemay Nassery is an engineering leader specializing in experimentation and personalization. With a notable track record that includes evolving Spotify's A/B testing strategy for the Homepage, launching Comcast's For You page, and establishing data warehousing teams at Etsy, she firmly believes that the key to innovation at any company is the ability to experiment effectively. Get a free eBook (PDF or ePub) from Manning as well as access to the online liveBook format (and its AI assistant that will answer your questions in any language) when you purchase the print book.
購物須知
外文書商品之書封，為出版社提供之樣本。實際出貨商品，以出版社所提供之現有版本為主。部份書籍，因出版社供應狀況特殊，匯率將依實際狀況做調整。
無庫存之商品，在您完成訂單程序之後，將以空運的方式為你下單調貨。為了縮短等待的時間，建議您將外文書與其他商品分開下單，以獲得最快的取貨速度，平均調貨時間為1~2個月。
為了保護您的權益，「三民網路書店」提供會員七日商品鑑賞期(收到商品為起始日)。
若要辦理退貨，請在商品鑑賞期內寄回，且商品必須是全新狀態與完整包裝(商品、附件、發票、隨貨贈品等)否則恕不接受退貨。