Interface PredictionServiceGrpc.AsyncService (3.32.0)
3.88.0 (latest)
3.86.0
3.84.0
3.83.0
3.82.0
3.81.0
3.79.0
3.77.0
3.76.0
3.75.0
3.74.0
3.73.0
3.71.0
3.69.0
3.68.0
3.65.0
3.64.0
3.63.0
3.61.0
3.60.0
3.59.0
3.58.0
3.57.0
3.56.0
3.55.0
3.54.0
3.53.0
3.52.0
3.50.0
3.49.0
3.48.0
3.47.0
3.46.0
3.45.0
3.44.0
3.43.0
3.42.0
3.41.0
3.40.0
3.38.0
3.37.0
3.36.0
3.35.0
3.34.0
3.33.0
3.32.0
3.31.0
3.30.0
3.29.0
3.28.0
3.25.0
3.24.0
3.23.0
3.22.0
3.21.0
3.20.0
3.19.0
3.18.0
3.17.0
3.16.0
3.15.0
3.14.0
3.13.0
3.12.0
3.11.0
3.10.0
3.9.0
3.8.0
3.7.0
3.6.0
3.5.0
3.4.2
3.3.0
3.2.0
3.0.0
2.9.8
2.8.9
2.7.4
2.5.3
2.4.0
public static interface PredictionServiceGrpc . AsyncService
A service for online predictions and explanations.
Methods
public default void directPredict ( DirectPredictRequest request , StreamObserver<DirectPredictResponse> responseObserver )
Perform an unary online prediction request for Vertex first-party products
and frameworks.
public default void directRawPredict ( DirectRawPredictRequest request , StreamObserver<DirectRawPredictResponse> responseObserver )
Perform an online prediction request through gRPC.
public default void explain ( ExplainRequest request , StreamObserver<ExplainResponse> responseObserver )
Perform an online explanation.
If
deployed_model_id
is specified, the corresponding DeployModel must have
explanation_spec
populated. If
deployed_model_id
is not specified, all DeployedModels must have
explanation_spec
populated.
public default void predict ( PredictRequest request , StreamObserver<PredictResponse> responseObserver )
Perform an online prediction.
rawPredict(RawPredictRequest request, StreamObserver<HttpBody> responseObserver)
public default void rawPredict ( RawPredictRequest request , StreamObserver<HttpBody> responseObserver )
Perform an online prediction with an arbitrary HTTP payload.
The response includes the following HTTP headers:
X-Vertex-AI-Endpoint-Id: ID of the
Endpoint that served this
prediction.X-Vertex-AI-Deployed-Model-Id: ID of the Endpoint's
DeployedModel that served this
prediction.
Parameters
Name Description
requestRawPredictRequest
responseObserverio.grpc.stub.StreamObserver <com.google.api.HttpBody >
public default void serverStreamingPredict ( StreamingPredictRequest request , StreamObserver<StreamingPredictResponse> responseObserver )
Perform a server-side streaming online prediction request for Vertex
LLM streaming.
public default StreamObserver<StreamingPredictRequest> streamingPredict ( StreamObserver<StreamingPredictResponse> responseObserver )
Perform a streaming online prediction request for Vertex first-party
products and frameworks.
public default StreamObserver<StreamingRawPredictRequest> streamingRawPredict ( StreamObserver<StreamingRawPredictResponse> responseObserver )
Perform a streaming online prediction request through gRPC.
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2026-03-14 UTC.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2026-03-14 UTC."],[],[]]
