Agent Evaluation Metric for multi-turn conversations
AWS introduces a turn-level evaluation metric for multi-turn conversations.
AWS has unveiled the Agent Evaluation Metric (AEM), which offers a decomposable way to assess multi-turn agent quality. By isolating errors in specific turns, AEM addresses the shortcomings of existing holistic evaluation methods, which fail to pinpoint the root causes of failures in conversations.