Some or all of the information on this page might not apply to Cloud de Confiance by S3NS. See Differences from Google Cloud for more details.

Vertex AI v1beta1 API - Class LlmUtilityService.LlmUtilityServiceBase (1.0.0-beta55)

[BindServiceMethod(typeof(LlmUtilityService), "BindService")]
public abstract class LlmUtilityService.LlmUtilityServiceBase

Reference documentation and code samples for the Vertex AI v1beta1 API class LlmUtilityService.LlmUtilityServiceBase.

Base class for server-side implementations of LlmUtilityService

Inheritance

object > LlmUtilityService.LlmUtilityServiceBase

Google.Cloud.AIPlatform.V1Beta1.dll

public virtual Task<ComputeTokensResponse> ComputeTokens(ComputeTokensRequest request, ServerCallContext context)

Return a list of tokens based on the input text.

Parameters
Name	Description
`request`	`ComputeTokensRequest` The request received from the client.
`context`	`ServerCallContext` The context of the server-side call handler being invoked.

Returns
Type	Description
`TaskComputeTokensResponse`	The response to send back to the client (wrapped by a task).