From the course: Agentic AI Design Patterns for GenAI and Predictive AI
Unlock this course with a free trial
Join today to access over 25,500 courses taught by industry experts.
Shadow model deployment
From the course: Agentic AI Design Patterns for GenAI and Predictive AI
Shadow model deployment
- So the proactive retraining pattern we just covered in the previous video provides a very effective way of detecting model drift issues early on. It allows us to automate this detection process so that we don't have to rely only on humans to notice drift issues. It also automates some or part of the challenger model retraining process, which speeds up traditional, more manual retraining process steps. But for some organizations or requirements, this is just not good enough. When the results being produced by a champion model with drift issues are being used in production environments for important business activity or important decision making, then it can be dangerous to continue using that model until a replacement challenger model is available. On the other hand, it can also be damaging to shut down the AI system and then wait until the new challenger model has been retrained and is ready for deployment. That's one…