- 1.30.1 (latest)
- 1.30.0
- 1.29.0
- 1.28.0
- 1.27.0
- 1.26.0
- 1.25.0
- 1.24.0
- 1.23.1
- 1.22.0
- 1.21.0
- 1.20.0
- 1.19.0
- 1.18.0
- 1.17.0
- 1.16.0
- 1.15.0
- 1.14.0
- 1.13.0
- 1.12.0
- 1.11.0
- 1.10.0
- 1.9.0
- 1.8.0
- 1.7.0
- 1.6.0
- 1.5.0
- 1.4.0
- 1.3.0
- 1.2.0
- 1.1.0
- 1.0.0
- 0.64.0
- 0.63.0
- 0.62.0
- 0.61.0
- 0.60.0
- 0.59.0
- 0.58.0
- 0.57.0
- 0.56.0
- 0.55.0
- 0.54.0
- 0.53.0
- 0.52.0
- 0.51.0
- 0.50.0
- 0.49.0
- 0.48.0
- 0.47.0
- 0.46.0
- 0.45.0
- 0.44.0
- 0.43.0
- 0.42.0
- 0.41.0
- 0.40.0
- 0.39.0
- 0.38.0
- 0.37.0
- 0.36.0
- 0.35.0
- 0.34.0
- 0.33.0
- 0.32.0
- 0.31.0
- 0.30.0
- 0.29.0
- 0.28.0
- 0.27.0
- 0.26.0
- 0.25.0
- 0.24.0
- 0.23.0
- 0.22.0
- 0.21.0
- 0.20.0
- 0.19.0
- 0.18.0
- 0.17.0
- 0.16.0
- 0.15.0
- 0.14.0
- 0.13.0
- 0.12.0
- 0.11.0
- 0.10.0
- 0.9.1
- 0.8.0
- 0.7.0
- 0.6.0
- 0.5.0
- 0.4.0
- 0.3.0
- 0.2.0
- 0.1.0
Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse.
Response message for EvaluationService.EvaluateInstances.
Inherits
- Object
Extended By
- Google::Protobuf::MessageExts::ClassMethods
Includes
- Google::Protobuf::MessageExts
Methods
#bleu_results
def bleu_results() -> ::Google::Cloud::AIPlatform::V1::BleuResults-
(::Google::Cloud::AIPlatform::V1::BleuResults) — Results for bleu metric.
Note: The following fields are mutually exclusive:
bleu_results,exact_match_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#bleu_results=
def bleu_results=(value) -> ::Google::Cloud::AIPlatform::V1::BleuResults-
value (::Google::Cloud::AIPlatform::V1::BleuResults) — Results for bleu metric.
Note: The following fields are mutually exclusive:
bleu_results,exact_match_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::BleuResults) — Results for bleu metric.
Note: The following fields are mutually exclusive:
bleu_results,exact_match_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#coherence_result
def coherence_result() -> ::Google::Cloud::AIPlatform::V1::CoherenceResult-
(::Google::Cloud::AIPlatform::V1::CoherenceResult) — Result for coherence metric.
Note: The following fields are mutually exclusive:
coherence_result,exact_match_results,bleu_results,rouge_results,fluency_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#coherence_result=
def coherence_result=(value) -> ::Google::Cloud::AIPlatform::V1::CoherenceResult-
value (::Google::Cloud::AIPlatform::V1::CoherenceResult) — Result for coherence metric.
Note: The following fields are mutually exclusive:
coherence_result,exact_match_results,bleu_results,rouge_results,fluency_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::CoherenceResult) — Result for coherence metric.
Note: The following fields are mutually exclusive:
coherence_result,exact_match_results,bleu_results,rouge_results,fluency_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#comet_result
def comet_result() -> ::Google::Cloud::AIPlatform::V1::CometResult-
(::Google::Cloud::AIPlatform::V1::CometResult) — Translation metrics.
Result for Comet metric.
Note: The following fields are mutually exclusive:
comet_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#comet_result=
def comet_result=(value) -> ::Google::Cloud::AIPlatform::V1::CometResult-
value (::Google::Cloud::AIPlatform::V1::CometResult) — Translation metrics.
Result for Comet metric.
Note: The following fields are mutually exclusive:
comet_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::CometResult) — Translation metrics.
Result for Comet metric.
Note: The following fields are mutually exclusive:
comet_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#exact_match_results
def exact_match_results() -> ::Google::Cloud::AIPlatform::V1::ExactMatchResults-
(::Google::Cloud::AIPlatform::V1::ExactMatchResults) — Auto metric evaluation results.
Results for exact match metric.
Note: The following fields are mutually exclusive:
exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#exact_match_results=
def exact_match_results=(value) -> ::Google::Cloud::AIPlatform::V1::ExactMatchResults-
value (::Google::Cloud::AIPlatform::V1::ExactMatchResults) — Auto metric evaluation results.
Results for exact match metric.
Note: The following fields are mutually exclusive:
exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::ExactMatchResults) — Auto metric evaluation results.
Results for exact match metric.
Note: The following fields are mutually exclusive:
exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#fluency_result
def fluency_result() -> ::Google::Cloud::AIPlatform::V1::FluencyResult-
(::Google::Cloud::AIPlatform::V1::FluencyResult) — LLM-based metric evaluation result.
General text generation metrics, applicable to other categories.
Result for fluency metric.
Note: The following fields are mutually exclusive:
fluency_result,exact_match_results,bleu_results,rouge_results,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#fluency_result=
def fluency_result=(value) -> ::Google::Cloud::AIPlatform::V1::FluencyResult-
value (::Google::Cloud::AIPlatform::V1::FluencyResult) — LLM-based metric evaluation result.
General text generation metrics, applicable to other categories.
Result for fluency metric.
Note: The following fields are mutually exclusive:
fluency_result,exact_match_results,bleu_results,rouge_results,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::FluencyResult) — LLM-based metric evaluation result.
General text generation metrics, applicable to other categories.
Result for fluency metric.
Note: The following fields are mutually exclusive:
fluency_result,exact_match_results,bleu_results,rouge_results,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#fulfillment_result
def fulfillment_result() -> ::Google::Cloud::AIPlatform::V1::FulfillmentResult-
(::Google::Cloud::AIPlatform::V1::FulfillmentResult) — Result for fulfillment metric.
Note: The following fields are mutually exclusive:
fulfillment_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#fulfillment_result=
def fulfillment_result=(value) -> ::Google::Cloud::AIPlatform::V1::FulfillmentResult-
value (::Google::Cloud::AIPlatform::V1::FulfillmentResult) — Result for fulfillment metric.
Note: The following fields are mutually exclusive:
fulfillment_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::FulfillmentResult) — Result for fulfillment metric.
Note: The following fields are mutually exclusive:
fulfillment_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#groundedness_result
def groundedness_result() -> ::Google::Cloud::AIPlatform::V1::GroundednessResult-
(::Google::Cloud::AIPlatform::V1::GroundednessResult) — Result for groundedness metric.
Note: The following fields are mutually exclusive:
groundedness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#groundedness_result=
def groundedness_result=(value) -> ::Google::Cloud::AIPlatform::V1::GroundednessResult-
value (::Google::Cloud::AIPlatform::V1::GroundednessResult) — Result for groundedness metric.
Note: The following fields are mutually exclusive:
groundedness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::GroundednessResult) — Result for groundedness metric.
Note: The following fields are mutually exclusive:
groundedness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#metricx_result
def metricx_result() -> ::Google::Cloud::AIPlatform::V1::MetricxResult-
(::Google::Cloud::AIPlatform::V1::MetricxResult) — Result for Metricx metric.
Note: The following fields are mutually exclusive:
metricx_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#metricx_result=
def metricx_result=(value) -> ::Google::Cloud::AIPlatform::V1::MetricxResult-
value (::Google::Cloud::AIPlatform::V1::MetricxResult) — Result for Metricx metric.
Note: The following fields are mutually exclusive:
metricx_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::MetricxResult) — Result for Metricx metric.
Note: The following fields are mutually exclusive:
metricx_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_metric_result
def pairwise_metric_result() -> ::Google::Cloud::AIPlatform::V1::PairwiseMetricResult-
(::Google::Cloud::AIPlatform::V1::PairwiseMetricResult) — Result for pairwise metric.
Note: The following fields are mutually exclusive:
pairwise_metric_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_metric_result=
def pairwise_metric_result=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseMetricResult-
value (::Google::Cloud::AIPlatform::V1::PairwiseMetricResult) — Result for pairwise metric.
Note: The following fields are mutually exclusive:
pairwise_metric_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::PairwiseMetricResult) — Result for pairwise metric.
Note: The following fields are mutually exclusive:
pairwise_metric_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_question_answering_quality_result
def pairwise_question_answering_quality_result() -> ::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityResult-
(::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityResult) — Result for pairwise question answering quality metric.
Note: The following fields are mutually exclusive:
pairwise_question_answering_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_question_answering_quality_result=
def pairwise_question_answering_quality_result=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityResult-
value (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityResult) — Result for pairwise question answering quality metric.
Note: The following fields are mutually exclusive:
pairwise_question_answering_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityResult) — Result for pairwise question answering quality metric.
Note: The following fields are mutually exclusive:
pairwise_question_answering_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_summarization_quality_result
def pairwise_summarization_quality_result() -> ::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityResult-
(::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityResult) — Result for pairwise summarization quality metric.
Note: The following fields are mutually exclusive:
pairwise_summarization_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_summarization_quality_result=
def pairwise_summarization_quality_result=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityResult-
value (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityResult) — Result for pairwise summarization quality metric.
Note: The following fields are mutually exclusive:
pairwise_summarization_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityResult) — Result for pairwise summarization quality metric.
Note: The following fields are mutually exclusive:
pairwise_summarization_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pointwise_metric_result
def pointwise_metric_result() -> ::Google::Cloud::AIPlatform::V1::PointwiseMetricResult-
(::Google::Cloud::AIPlatform::V1::PointwiseMetricResult) — Generic metrics.
Result for pointwise metric.
Note: The following fields are mutually exclusive:
pointwise_metric_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pointwise_metric_result=
def pointwise_metric_result=(value) -> ::Google::Cloud::AIPlatform::V1::PointwiseMetricResult-
value (::Google::Cloud::AIPlatform::V1::PointwiseMetricResult) — Generic metrics.
Result for pointwise metric.
Note: The following fields are mutually exclusive:
pointwise_metric_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::PointwiseMetricResult) — Generic metrics.
Result for pointwise metric.
Note: The following fields are mutually exclusive:
pointwise_metric_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_correctness_result
def question_answering_correctness_result() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessResult-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessResult) — Result for question answering correctness metric.
Note: The following fields are mutually exclusive:
question_answering_correctness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_correctness_result=
def question_answering_correctness_result=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessResult-
value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessResult) — Result for question answering correctness metric.
Note: The following fields are mutually exclusive:
question_answering_correctness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessResult) — Result for question answering correctness metric.
Note: The following fields are mutually exclusive:
question_answering_correctness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_helpfulness_result
def question_answering_helpfulness_result() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessResult-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessResult) — Result for question answering helpfulness metric.
Note: The following fields are mutually exclusive:
question_answering_helpfulness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_helpfulness_result=
def question_answering_helpfulness_result=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessResult-
value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessResult) — Result for question answering helpfulness metric.
Note: The following fields are mutually exclusive:
question_answering_helpfulness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessResult) — Result for question answering helpfulness metric.
Note: The following fields are mutually exclusive:
question_answering_helpfulness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_quality_result
def question_answering_quality_result() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityResult-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityResult) — Question answering only metrics.
Result for question answering quality metric.
Note: The following fields are mutually exclusive:
question_answering_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_quality_result=
def question_answering_quality_result=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityResult-
value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityResult) — Question answering only metrics.
Result for question answering quality metric.
Note: The following fields are mutually exclusive:
question_answering_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityResult) — Question answering only metrics.
Result for question answering quality metric.
Note: The following fields are mutually exclusive:
question_answering_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_relevance_result
def question_answering_relevance_result() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceResult-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceResult) — Result for question answering relevance metric.
Note: The following fields are mutually exclusive:
question_answering_relevance_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_relevance_result=
def question_answering_relevance_result=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceResult-
value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceResult) — Result for question answering relevance metric.
Note: The following fields are mutually exclusive:
question_answering_relevance_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceResult) — Result for question answering relevance metric.
Note: The following fields are mutually exclusive:
question_answering_relevance_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#rouge_results
def rouge_results() -> ::Google::Cloud::AIPlatform::V1::RougeResults-
(::Google::Cloud::AIPlatform::V1::RougeResults) — Results for rouge metric.
Note: The following fields are mutually exclusive:
rouge_results,exact_match_results,bleu_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#rouge_results=
def rouge_results=(value) -> ::Google::Cloud::AIPlatform::V1::RougeResults-
value (::Google::Cloud::AIPlatform::V1::RougeResults) — Results for rouge metric.
Note: The following fields are mutually exclusive:
rouge_results,exact_match_results,bleu_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::RougeResults) — Results for rouge metric.
Note: The following fields are mutually exclusive:
rouge_results,exact_match_results,bleu_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#safety_result
def safety_result() -> ::Google::Cloud::AIPlatform::V1::SafetyResult-
(::Google::Cloud::AIPlatform::V1::SafetyResult) — Result for safety metric.
Note: The following fields are mutually exclusive:
safety_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#safety_result=
def safety_result=(value) -> ::Google::Cloud::AIPlatform::V1::SafetyResult-
value (::Google::Cloud::AIPlatform::V1::SafetyResult) — Result for safety metric.
Note: The following fields are mutually exclusive:
safety_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::SafetyResult) — Result for safety metric.
Note: The following fields are mutually exclusive:
safety_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_helpfulness_result
def summarization_helpfulness_result() -> ::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessResult-
(::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessResult) — Result for summarization helpfulness metric.
Note: The following fields are mutually exclusive:
summarization_helpfulness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_helpfulness_result=
def summarization_helpfulness_result=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessResult-
value (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessResult) — Result for summarization helpfulness metric.
Note: The following fields are mutually exclusive:
summarization_helpfulness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessResult) — Result for summarization helpfulness metric.
Note: The following fields are mutually exclusive:
summarization_helpfulness_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_quality_result
def summarization_quality_result() -> ::Google::Cloud::AIPlatform::V1::SummarizationQualityResult-
(::Google::Cloud::AIPlatform::V1::SummarizationQualityResult) — Summarization only metrics.
Result for summarization quality metric.
Note: The following fields are mutually exclusive:
summarization_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_quality_result=
def summarization_quality_result=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationQualityResult-
value (::Google::Cloud::AIPlatform::V1::SummarizationQualityResult) — Summarization only metrics.
Result for summarization quality metric.
Note: The following fields are mutually exclusive:
summarization_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::SummarizationQualityResult) — Summarization only metrics.
Result for summarization quality metric.
Note: The following fields are mutually exclusive:
summarization_quality_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_verbosity_result
def summarization_verbosity_result() -> ::Google::Cloud::AIPlatform::V1::SummarizationVerbosityResult-
(::Google::Cloud::AIPlatform::V1::SummarizationVerbosityResult) — Result for summarization verbosity metric.
Note: The following fields are mutually exclusive:
summarization_verbosity_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_verbosity_result=
def summarization_verbosity_result=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationVerbosityResult-
value (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityResult) — Result for summarization verbosity metric.
Note: The following fields are mutually exclusive:
summarization_verbosity_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::SummarizationVerbosityResult) — Result for summarization verbosity metric.
Note: The following fields are mutually exclusive:
summarization_verbosity_result,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_call_valid_results
def tool_call_valid_results() -> ::Google::Cloud::AIPlatform::V1::ToolCallValidResults-
(::Google::Cloud::AIPlatform::V1::ToolCallValidResults) — Tool call metrics.
Results for tool call valid metric.
Note: The following fields are mutually exclusive:
tool_call_valid_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_call_valid_results=
def tool_call_valid_results=(value) -> ::Google::Cloud::AIPlatform::V1::ToolCallValidResults-
value (::Google::Cloud::AIPlatform::V1::ToolCallValidResults) — Tool call metrics.
Results for tool call valid metric.
Note: The following fields are mutually exclusive:
tool_call_valid_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::ToolCallValidResults) — Tool call metrics.
Results for tool call valid metric.
Note: The following fields are mutually exclusive:
tool_call_valid_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_name_match_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_name_match_results
def tool_name_match_results() -> ::Google::Cloud::AIPlatform::V1::ToolNameMatchResults-
(::Google::Cloud::AIPlatform::V1::ToolNameMatchResults) — Results for tool name match metric.
Note: The following fields are mutually exclusive:
tool_name_match_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_name_match_results=
def tool_name_match_results=(value) -> ::Google::Cloud::AIPlatform::V1::ToolNameMatchResults-
value (::Google::Cloud::AIPlatform::V1::ToolNameMatchResults) — Results for tool name match metric.
Note: The following fields are mutually exclusive:
tool_name_match_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::ToolNameMatchResults) — Results for tool name match metric.
Note: The following fields are mutually exclusive:
tool_name_match_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_parameter_key_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_parameter_key_match_results
def tool_parameter_key_match_results() -> ::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchResults-
(::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchResults) — Results for tool parameter key match metric.
Note: The following fields are mutually exclusive:
tool_parameter_key_match_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_parameter_key_match_results=
def tool_parameter_key_match_results=(value) -> ::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchResults-
value (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchResults) — Results for tool parameter key match metric.
Note: The following fields are mutually exclusive:
tool_parameter_key_match_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchResults) — Results for tool parameter key match metric.
Note: The following fields are mutually exclusive:
tool_parameter_key_match_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_kv_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_parameter_kv_match_results
def tool_parameter_kv_match_results() -> ::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchResults-
(::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchResults) — Results for tool parameter key value match metric.
Note: The following fields are mutually exclusive:
tool_parameter_kv_match_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_parameter_kv_match_results=
def tool_parameter_kv_match_results=(value) -> ::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchResults-
value (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchResults) — Results for tool parameter key value match metric.
Note: The following fields are mutually exclusive:
tool_parameter_kv_match_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchResults) — Results for tool parameter key value match metric.
Note: The following fields are mutually exclusive:
tool_parameter_kv_match_results,exact_match_results,bleu_results,rouge_results,fluency_result,coherence_result,safety_result,groundedness_result,fulfillment_result,summarization_quality_result,pairwise_summarization_quality_result,summarization_helpfulness_result,summarization_verbosity_result,question_answering_quality_result,pairwise_question_answering_quality_result,question_answering_relevance_result,question_answering_helpfulness_result,question_answering_correctness_result,pointwise_metric_result,pairwise_metric_result,tool_call_valid_results,tool_name_match_results,tool_parameter_key_match_results,comet_result,metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.