From the course: Agentic AI: Build Your First Agentic AI System

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Implement baseline system update (CD)

Implement baseline system update (CD)

Now that we've gone through the continuous calibration phase, and we have some actionable feedback on how to improve our system, let's go to the second part, which is Continuous Development, or CD. Now in this phase, we want to make targeted improvements based on the feedback that we've observed and the annotations that we have done, and we re-evaluate with the same metrics, which here is routing accuracy, and compare before and after performance, and validate our improvements. Now remember, we saw a bunch of issues with the system prompt, the first prompt that we use. So what we've done now is to have a second prompt, a system prompt too, where we explain all the departments and what they mean, so that the agent is better equipped to make classification decisions or domain routing decisions. You can see that my second system prompt has information of what billing refers to. I have a few examples to say, payment issues, charges, refunds, refund status, account balances, and fees fall…

Contents