Acme Corp/

A/B Testing

Compare

Insurance Bot Baseline vs Fine-tuned

Add a Call
Call APassed
IB
Insurance Bot v1GPT-4.1
0/20
Duration: 2m 15sPass Rate: 85%
Call BFailed
IB
Insurance Bot v2Sonnet 4.5
0/20
Duration: 3m 42sPass Rate: 70%

Insurance Bot v1

PASS

Insurance Bot v2

FAIL
EvaluationTranscripts

Resolution & Tool Usage

4/4PASS
2/4FAIL

Communication & Empathy

3/4PASS
4/4PASS

Greeting & First Impression

3/3PASS
1/3FAIL

AI Trustworthiness

3/3PASS
3/3PASS

Conversation Dynamics

3/4PASS
2/4FAIL

Closing & Follow-up

2/2PASS
1/2FAIL