- 1.43.0 (latest)
- 1.42.0
- 1.41.0
- 1.40.0
- 1.39.0
- 1.38.0
- 1.37.0
- 1.36.0
- 1.35.0
- 1.34.0
- 1.33.0
- 1.32.1
- 1.31.0
- 1.30.0
- 1.26.0
- 1.23.0
- 1.22.0
- 1.21.0
- 1.20.0
- 1.19.0
- 1.18.0
- 1.17.0
- 1.16.0
- 1.15.0
- 1.14.0
- 1.13.1
- 1.12.0
- 1.11.0
- 1.10.0
- 1.9.0
- 1.8.0
- 1.7.0
- 1.6.0
- 1.5.0
- 1.4.0
- 1.3.0
- 1.2.0
- 1.1.0
- 1.0.0
- 0.39.0
- 0.38.0
- 0.37.1
- 0.32.0
- 0.31.0
- 0.30.0
- 0.29.0
- 0.28.0
- 0.27.0
- 0.26.2
- 0.25.0
- 0.24.0
- 0.23.0
- 0.22.0
- 0.21.0
- 0.20.0
- 0.19.0
- 0.18.0
- 0.17.0
- 0.16.0
- 0.15.0
- 0.13.0
- 0.12.0
- 0.11.1
- 0.10.0
Reference documentation and code samples for the Google Cloud Ai Platform V1 Client class EvaluateInstancesRequest.
Request message for EvaluationService.EvaluateInstances.
Generated from protobuf message google.cloud.aiplatform.v1.EvaluateInstancesRequest
Namespace
Google \ Cloud \ AIPlatform \ V1Methods
__construct
Constructor.
| Parameters | |
|---|---|
| Name | Description | 
| data | arrayOptional. Data for populating the Message object. | 
| ↳ exact_match_input | ExactMatchInputAuto metric instances. Instances and metric spec for exact match metric. | 
| ↳ bleu_input | BleuInputInstances and metric spec for bleu metric. | 
| ↳ rouge_input | RougeInputInstances and metric spec for rouge metric. | 
| ↳ fluency_input | FluencyInputLLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric. | 
| ↳ coherence_input | CoherenceInputInput for coherence metric. | 
| ↳ safety_input | SafetyInputInput for safety metric. | 
| ↳ groundedness_input | GroundednessInputInput for groundedness metric. | 
| ↳ fulfillment_input | FulfillmentInputInput for fulfillment metric. | 
| ↳ summarization_quality_input | SummarizationQualityInputInput for summarization quality metric. | 
| ↳ pairwise_summarization_quality_input | PairwiseSummarizationQualityInputInput for pairwise summarization quality metric. | 
| ↳ summarization_helpfulness_input | SummarizationHelpfulnessInputInput for summarization helpfulness metric. | 
| ↳ summarization_verbosity_input | SummarizationVerbosityInputInput for summarization verbosity metric. | 
| ↳ question_answering_quality_input | QuestionAnsweringQualityInputInput for question answering quality metric. | 
| ↳ pairwise_question_answering_quality_input | PairwiseQuestionAnsweringQualityInputInput for pairwise question answering quality metric. | 
| ↳ question_answering_relevance_input | QuestionAnsweringRelevanceInputInput for question answering relevance metric. | 
| ↳ question_answering_helpfulness_input | QuestionAnsweringHelpfulnessInputInput for question answering helpfulness metric. | 
| ↳ question_answering_correctness_input | QuestionAnsweringCorrectnessInputInput for question answering correctness metric. | 
| ↳ pointwise_metric_input | PointwiseMetricInputInput for pointwise metric. | 
| ↳ pairwise_metric_input | PairwiseMetricInputInput for pairwise metric. | 
| ↳ tool_call_valid_input | ToolCallValidInputTool call metric instances. Input for tool call valid metric. | 
| ↳ tool_name_match_input | ToolNameMatchInputInput for tool name match metric. | 
| ↳ tool_parameter_key_match_input | ToolParameterKeyMatchInputInput for tool parameter key match metric. | 
| ↳ tool_parameter_kv_match_input | ToolParameterKVMatchInputInput for tool parameter key value match metric. | 
| ↳ comet_input | CometInputTranslation metrics. Input for Comet metric. | 
| ↳ metricx_input | MetricxInputInput for Metricx metric. | 
| ↳ location | stringRequired. The resource name of the Location to evaluate the instances. Format:  | 
getExactMatchInput
Auto metric instances.
Instances and metric spec for exact match metric.
| Returns | |
|---|---|
| Type | Description | 
| ExactMatchInput|null | |
hasExactMatchInput
setExactMatchInput
Auto metric instances.
Instances and metric spec for exact match metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | ExactMatchInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getBleuInput
Instances and metric spec for bleu metric.
| Returns | |
|---|---|
| Type | Description | 
| BleuInput|null | |
hasBleuInput
setBleuInput
Instances and metric spec for bleu metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | BleuInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getRougeInput
Instances and metric spec for rouge metric.
| Returns | |
|---|---|
| Type | Description | 
| RougeInput|null | |
hasRougeInput
setRougeInput
Instances and metric spec for rouge metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | RougeInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getFluencyInput
LLM-based metric instance.
General text generation metrics, applicable to other categories. Input for fluency metric.
| Returns | |
|---|---|
| Type | Description | 
| FluencyInput|null | |
hasFluencyInput
setFluencyInput
LLM-based metric instance.
General text generation metrics, applicable to other categories. Input for fluency metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | FluencyInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getCoherenceInput
Input for coherence metric.
| Returns | |
|---|---|
| Type | Description | 
| CoherenceInput|null | |
hasCoherenceInput
setCoherenceInput
Input for coherence metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | CoherenceInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getSafetyInput
Input for safety metric.
| Returns | |
|---|---|
| Type | Description | 
| SafetyInput|null | |
hasSafetyInput
setSafetyInput
Input for safety metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | SafetyInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getGroundednessInput
Input for groundedness metric.
| Returns | |
|---|---|
| Type | Description | 
| GroundednessInput|null | |
hasGroundednessInput
setGroundednessInput
Input for groundedness metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | GroundednessInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getFulfillmentInput
Input for fulfillment metric.
| Returns | |
|---|---|
| Type | Description | 
| FulfillmentInput|null | |
hasFulfillmentInput
setFulfillmentInput
Input for fulfillment metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | FulfillmentInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getSummarizationQualityInput
Input for summarization quality metric.
| Returns | |
|---|---|
| Type | Description | 
| SummarizationQualityInput|null | |
hasSummarizationQualityInput
setSummarizationQualityInput
Input for summarization quality metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | SummarizationQualityInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getPairwiseSummarizationQualityInput
Input for pairwise summarization quality metric.
| Returns | |
|---|---|
| Type | Description | 
| PairwiseSummarizationQualityInput|null | |
hasPairwiseSummarizationQualityInput
setPairwiseSummarizationQualityInput
Input for pairwise summarization quality metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | PairwiseSummarizationQualityInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getSummarizationHelpfulnessInput
Input for summarization helpfulness metric.
| Returns | |
|---|---|
| Type | Description | 
| SummarizationHelpfulnessInput|null | |
hasSummarizationHelpfulnessInput
setSummarizationHelpfulnessInput
Input for summarization helpfulness metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | SummarizationHelpfulnessInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getSummarizationVerbosityInput
Input for summarization verbosity metric.
| Returns | |
|---|---|
| Type | Description | 
| SummarizationVerbosityInput|null | |
hasSummarizationVerbosityInput
setSummarizationVerbosityInput
Input for summarization verbosity metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | SummarizationVerbosityInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getQuestionAnsweringQualityInput
Input for question answering quality metric.
| Returns | |
|---|---|
| Type | Description | 
| QuestionAnsweringQualityInput|null | |
hasQuestionAnsweringQualityInput
setQuestionAnsweringQualityInput
Input for question answering quality metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | QuestionAnsweringQualityInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getPairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric.
| Returns | |
|---|---|
| Type | Description | 
| PairwiseQuestionAnsweringQualityInput|null | |
hasPairwiseQuestionAnsweringQualityInput
setPairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | PairwiseQuestionAnsweringQualityInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getQuestionAnsweringRelevanceInput
Input for question answering relevance metric.
| Returns | |
|---|---|
| Type | Description | 
| QuestionAnsweringRelevanceInput|null | |
hasQuestionAnsweringRelevanceInput
setQuestionAnsweringRelevanceInput
Input for question answering relevance metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | QuestionAnsweringRelevanceInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getQuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric.
| Returns | |
|---|---|
| Type | Description | 
| QuestionAnsweringHelpfulnessInput|null | |
hasQuestionAnsweringHelpfulnessInput
setQuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | QuestionAnsweringHelpfulnessInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getQuestionAnsweringCorrectnessInput
Input for question answering correctness metric.
| Returns | |
|---|---|
| Type | Description | 
| QuestionAnsweringCorrectnessInput|null | |
hasQuestionAnsweringCorrectnessInput
setQuestionAnsweringCorrectnessInput
Input for question answering correctness metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | QuestionAnsweringCorrectnessInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getPointwiseMetricInput
Input for pointwise metric.
| Returns | |
|---|---|
| Type | Description | 
| PointwiseMetricInput|null | |
hasPointwiseMetricInput
setPointwiseMetricInput
Input for pointwise metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | PointwiseMetricInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getPairwiseMetricInput
Input for pairwise metric.
| Returns | |
|---|---|
| Type | Description | 
| PairwiseMetricInput|null | |
hasPairwiseMetricInput
setPairwiseMetricInput
Input for pairwise metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | PairwiseMetricInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getToolCallValidInput
Tool call metric instances.
Input for tool call valid metric.
| Returns | |
|---|---|
| Type | Description | 
| ToolCallValidInput|null | |
hasToolCallValidInput
setToolCallValidInput
Tool call metric instances.
Input for tool call valid metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | ToolCallValidInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getToolNameMatchInput
Input for tool name match metric.
| Returns | |
|---|---|
| Type | Description | 
| ToolNameMatchInput|null | |
hasToolNameMatchInput
setToolNameMatchInput
Input for tool name match metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | ToolNameMatchInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getToolParameterKeyMatchInput
Input for tool parameter key match metric.
| Returns | |
|---|---|
| Type | Description | 
| ToolParameterKeyMatchInput|null | |
hasToolParameterKeyMatchInput
setToolParameterKeyMatchInput
Input for tool parameter key match metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | ToolParameterKeyMatchInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getToolParameterKvMatchInput
Input for tool parameter key value match metric.
| Returns | |
|---|---|
| Type | Description | 
| ToolParameterKVMatchInput|null | |
hasToolParameterKvMatchInput
setToolParameterKvMatchInput
Input for tool parameter key value match metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | ToolParameterKVMatchInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getCometInput
Translation metrics.
Input for Comet metric.
| Returns | |
|---|---|
| Type | Description | 
| CometInput|null | |
hasCometInput
setCometInput
Translation metrics.
Input for Comet metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | CometInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getMetricxInput
Input for Metricx metric.
| Returns | |
|---|---|
| Type | Description | 
| MetricxInput|null | |
hasMetricxInput
setMetricxInput
Input for Metricx metric.
| Parameter | |
|---|---|
| Name | Description | 
| var | MetricxInput | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getLocation
Required. The resource name of the Location to evaluate the instances.
Format: projects/{project}/locations/{location}
| Returns | |
|---|---|
| Type | Description | 
| string | |
setLocation
Required. The resource name of the Location to evaluate the instances.
Format: projects/{project}/locations/{location}
| Parameter | |
|---|---|
| Name | Description | 
| var | string | 
| Returns | |
|---|---|
| Type | Description | 
| $this | |
getMetricInputs
| Returns | |
|---|---|
| Type | Description | 
| string | |