David Krantz

Agent benchmarks are great, but you need to actually understand your end user’s experience. We've released four new agentic metrics, enabling you to track how your agents behave in real-world scenarios and how users experience flow, efficiency, intent change, and conversation quality, all available out of the box. Agent Flow: Measure the correctness and coherence of an agentic trajectory by validating it against user-specified natural language tests. When building multi-step agents, this metric helps you catch deviations from expected behavior patterns. Agent Efficiency: Assess the efficiency of your agentic workflows. An agentic session is considered efficient or optimal when the agent provides a precise answer or resolution to every user ask, with an efficient path. Does your agent reach the solution in three steps or thirteen? This metric helps you identify unnecessary tool calls, redundant questions, and bloated workflows. Conversation Quality: Evaluate the overall user experience across multi-turn conversations. Beyond accuracy, it measures whether interactions leave users satisfied or frustrated, critical for customer-facing applications. Intent Change: Detect when users shift their goals mid-conversation. These shifts often indicate gaps in your agent's ability to handle the initial request, providing clear signals for improvement. Each metric is designed for production agents, providing granular visibility into behavior that traditional evals miss, and can be customized to your specific application, further extending our agent evals capabilities (which you can also access via our new MCP!). These are available to use for free today in Galileo, learn more about the new metrics below 👇

16

3 Comments

Commission clarity drives healthier pipelines and happier producers. In this episode clip, we unpack the payment flow, expected timelines, and practical ways to reduce delays—so revenue recognition and producer payouts stay predictable. If you lead an agency, share this with your team as a quick primer. #Insurance #IndependentAgents #AgencyLeadership #ProducerComp #Operations #compensation #agents #contracts #payments #buildyourlegacy

2

Not all B2B payment methods are created equal: • ACH payments are cost-effective for recurring domestic transfers (settling in 1–3 business days). • Cards offer near-instant settlement and clear transaction data—ideal for lower-volume or time-sensitive purchases. • Wires deliver same-day (domestic) or multi-day (international) transfers but carry higher fees. Using a single platform that supports ACH, cards, and wires can reduce foreign exchange (FX) markups, simplify reconciliation, and improve reporting accuracy. 👉 Dive deeper: https://lnkd.in/eYC-y52Q

2