Class SpeculativeDecodingSpec.NgramSpeculation.Builder (3.89.0)
3.88.0 (latest)
3.86.0
3.84.0
3.83.0
3.82.0
3.81.0
3.79.0
3.77.0
3.76.0
3.75.0
3.74.0
3.73.0
3.71.0
3.69.0
3.68.0
3.65.0
3.64.0
3.63.0
3.61.0
3.60.0
3.59.0
3.58.0
3.57.0
3.56.0
3.55.0
3.54.0
3.53.0
3.52.0
3.50.0
3.49.0
3.48.0
3.47.0
3.46.0
3.45.0
3.44.0
3.43.0
3.42.0
3.41.0
3.40.0
3.38.0
3.37.0
3.36.0
3.35.0
3.34.0
3.33.0
3.32.0
3.31.0
3.30.0
3.29.0
3.28.0
3.25.0
3.24.0
3.23.0
3.22.0
3.21.0
3.20.0
3.19.0
3.18.0
3.17.0
3.16.0
3.15.0
3.14.0
3.13.0
3.12.0
3.11.0
3.10.0
3.9.0
3.8.0
3.7.0
3.6.0
3.5.0
3.4.2
3.3.0
3.2.0
3.0.0
2.9.8
2.8.9
2.7.4
2.5.3
2.4.0
public static final class SpeculativeDecodingSpec . NgramSpeculation . Builder extends GeneratedMessage . Builder<SpeculativeDecodingSpec . NgramSpeculation . Builder > implements SpeculativeDecodingSpec . NgramSpeculationOrBuilder
N-Gram speculation works by trying to find matching tokens in the
previous prompt sequence and use those as speculation for generating
new tokens.
Protobuf type google.cloud.aiplatform.v1.SpeculativeDecodingSpec.NgramSpeculation
Inherited Members
com.google.protobuf.GeneratedMessage.Builder.getUnknownFieldSetBuilder()
com.google.protobuf.GeneratedMessage.Builder.internalGetMapFieldReflection(int)
com.google.protobuf.GeneratedMessage.Builder.internalGetMutableMapFieldReflection(int)
com.google.protobuf.GeneratedMessage.Builder.mergeUnknownLengthDelimitedField(int,com.google.protobuf.ByteString)
com.google.protobuf.GeneratedMessage.Builder.mergeUnknownVarintField(int,int)
com.google.protobuf.GeneratedMessage.Builder.parseUnknownField(com.google.protobuf.CodedInputStream,com.google.protobuf.ExtensionRegistryLite,int)
com.google.protobuf.GeneratedMessage.Builder.setUnknownFieldSetBuilder(com.google.protobuf.UnknownFieldSet.Builder)
com.google.protobuf.GeneratedMessage.Builder.setUnknownFieldsProto3(com.google.protobuf.UnknownFieldSet)
Static Methods
public static final Descriptors . Descriptor getDescriptor ()
Methods
public SpeculativeDecodingSpec . NgramSpeculation build ()
public SpeculativeDecodingSpec . NgramSpeculation buildPartial ()
public SpeculativeDecodingSpec . NgramSpeculation . Builder clear ()
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder clearNgramSize ()
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
public SpeculativeDecodingSpec . NgramSpeculation getDefaultInstanceForType ()
public Descriptors . Descriptor getDescriptorForType ()
Overrides
public int getNgramSize ()
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
Returns
Type Description
int The ngramSize.
protected GeneratedMessage . FieldAccessorTable internalGetFieldAccessorTable ()
Overrides
public final boolean isInitialized ()
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( SpeculativeDecodingSpec . NgramSpeculation other )
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( CodedInputStream input , ExtensionRegistryLite extensionRegistry )
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( Message other )
Parameter
Name Description
otherMessage
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder setNgramSize ( int value )
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
Parameter
Name Description
valueint The ngramSize to set.
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2026-03-31 UTC.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2026-03-31 UTC."],[],[]]
