Class LlmUtilityServiceGrpc.LlmUtilityServiceStub (0.5.0) 

public static final class LlmUtilityServiceGrpc.LlmUtilityServiceStub extends AbstractAsyncStub<LlmUtilityServiceGrpc.LlmUtilityServiceStub>

A stub to allow clients to do asynchronous rpc calls to service LlmUtilityService.

Service for LLM related utility functions.

Inheritance

java.lang.Object > io.grpc.stub.AbstractStub > io.grpc.stub.AbstractAsyncStub > LlmUtilityServiceGrpc.LlmUtilityServiceStub

Methods

build(Channel channel, CallOptions callOptions)

protected LlmUtilityServiceGrpc.LlmUtilityServiceStub build(Channel channel, CallOptions callOptions)
Parameters
Name Description
channel io.grpc.Channel
callOptions io.grpc.CallOptions
Returns
Type Description
LlmUtilityServiceGrpc.LlmUtilityServiceStub
Overrides
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)

computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)

public void computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)

Return a list of tokens based on the input text.

Parameters
Name Description
request ComputeTokensRequest
responseObserver io.grpc.stub.StreamObserver<ComputeTokensResponse>

countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)

public void countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)

Perform a token counting.

Parameters
Name Description
request CountTokensRequest
responseObserver io.grpc.stub.StreamObserver<CountTokensResponse>