Evaluation metrics when retrieving n smart replies with the
model.
Attributes
Name
Description
n
int
Number of retrieved smart replies. For example, when n
is 3, this evaluation contains metrics for when Dialogflow
retrieves 3 smart replies with the model.
recall
float
Defined as
number of queries whose top n smart replies have at least one similar (token match similarity above the defined threshold) reply as the real reply
divided by
number of queries with at least one smart reply. Value
ranges from 0.0 to 1.0 inclusive.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2026-03-31 UTC."],[],[]]
