Some or all of the information on this page might not apply to Trusted Cloud by S3NS. See Differences from Google Cloud for more details.

Interface SpeculativeDecodingSpec.NgramSpeculationOrBuilder (1.35.0)

public static interface SpeculativeDecodingSpec.NgramSpeculationOrBuilder extends MessageOrBuilder

Implements

MessageOrBuilder

Methods

getNgramSize()

public abstract int getNgramSize()

The number of last N input tokens used as ngram to search/match against the previous prompt sequence. This is equal to the N in N-Gram. The default value is 3 if not specified.

int32 ngram_size = 1;

Returns
Type	Description
`int`	The ngramSize.

Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Last updated 2025-09-30 UTC.