Understanding the 'Evaluation'

Learn about grading, score breakdown, and how to disagree with AutoQA’s assessment.

To view the full result of the AutoQA-evaluated conversation, start by selecting one with an average score from the list.

3z2.png

The third tab on the conversation file page leads to the ‘Evaluation’.

3z3.png

The panel on the left covers AutoQA Grading — how the scores were derived from both AutoQA and Manual QA-only and the score breakdown by section.3z4.pngSection

Name of section and the number of questions listed within it.

Category

Category that the question belongs to.

Target score

A minimum score that the agent needs to achieve for the question.

Validation

A snippet in the conversation that led to AutoQA’s score. Click on the bottom-arrow icon to display text.

3z5.png

AutoQA evaluation

The result of AI scoring (Yes/No) and the score set for the question. You have the option to disagree with AutoQA’s result by:

  • Excluding the result as an incorrect score.
  • Including the result as a correct score.

The agent’s score will be recalibrated according to the changes.

3z6.png

Manual QA-only scoring

The Manual QA-only scoring will be displayed if certain questions were not selected for AutoQA. You will have to submit an answer for the agent’s final score to be calculated.

3z7.png

Feedback

Add feedback related to the question. If other users added theirs, the history log and the comment will be displayed.

3z8.png

Switch between components with confidence by catching up on the audio visualizer, transcription, and overview.

Was this article helpful?
0 out of 0 found this helpful