Defines the behavior when an extra tool call is encountered.
An extra tool call is a tool call that is present in the
execution but does not match any tool call in the golden
expectation.
Enums
Name
Description
EXTRA_TOOL_CALL_BEHAVIOR_UNSPECIFIED
Unspecified behavior. Defaults to FAIL.
FAIL
Fail the evaluation if an extra tool call is encountered.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2026-04-03 UTC."],[],[]]
