Send feedback
Class SpeculativeDecodingSpec.NgramSpeculation.Builder (1.48.0)
Stay organized with collections
Save and categorize content based on your preferences.
1.48.0 (latest)
1.47.0
1.45.0
1.43.0
1.42.0
1.40.0
1.38.0
1.36.0
1.35.0
1.34.0
1.33.0
1.32.0
1.30.0
1.28.0
1.27.0
1.24.0
1.23.0
1.22.0
1.20.1
1.19.0
1.18.0
1.17.0
1.16.0
1.15.0
1.14.0
1.13.0
1.12.0
1.11.0
1.9.0
1.8.0
1.7.0
1.6.0
1.5.0
1.4.0
1.3.0
1.2.0
1.1.0
1.0.0
0.8.0
0.6.0
0.5.0
0.4.0
0.3.0
0.2.0
0.1.0
public static final class SpeculativeDecodingSpec . NgramSpeculation . Builder extends GeneratedMessage . Builder<SpeculativeDecodingSpec . NgramSpeculation . Builder > implements SpeculativeDecodingSpec . NgramSpeculationOrBuilder
N-Gram speculation works by trying to find matching tokens in the
previous prompt sequence and use those as speculation for generating
new tokens.
Protobuf type google.cloud.vertexai.v1.SpeculativeDecodingSpec.NgramSpeculation
Inherited Members
com.google.protobuf.GeneratedMessage.Builder.getUnknownFieldSetBuilder()
com.google.protobuf.GeneratedMessage.Builder.internalGetMapFieldReflection(int)
com.google.protobuf.GeneratedMessage.Builder.internalGetMutableMapFieldReflection(int)
com.google.protobuf.GeneratedMessage.Builder.mergeUnknownLengthDelimitedField(int,com.google.protobuf.ByteString)
com.google.protobuf.GeneratedMessage.Builder.mergeUnknownVarintField(int,int)
com.google.protobuf.GeneratedMessage.Builder.parseUnknownField(com.google.protobuf.CodedInputStream,com.google.protobuf.ExtensionRegistryLite,int)
com.google.protobuf.GeneratedMessage.Builder.setUnknownFieldSetBuilder(com.google.protobuf.UnknownFieldSet.Builder)
com.google.protobuf.GeneratedMessage.Builder.setUnknownFieldsProto3(com.google.protobuf.UnknownFieldSet)
Static Methods
getDescriptor()
public static final Descriptors . Descriptor getDescriptor ()
Methods
build()
public SpeculativeDecodingSpec . NgramSpeculation build ()
buildPartial()
public SpeculativeDecodingSpec . NgramSpeculation buildPartial ()
clear()
public SpeculativeDecodingSpec . NgramSpeculation . Builder clear ()
Overrides
clearNgramSize()
public SpeculativeDecodingSpec . NgramSpeculation . Builder clearNgramSize ()
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
getDefaultInstanceForType()
public SpeculativeDecodingSpec . NgramSpeculation getDefaultInstanceForType ()
getDescriptorForType()
public Descriptors . Descriptor getDescriptorForType ()
Overrides
getNgramSize()
public int getNgramSize ()
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
Returns
Type Description
int The ngramSize.
internalGetFieldAccessorTable()
protected GeneratedMessage . FieldAccessorTable internalGetFieldAccessorTable ()
Overrides
isInitialized()
public final boolean isInitialized ()
Overrides
mergeFrom(SpeculativeDecodingSpec.NgramSpeculation other)
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( SpeculativeDecodingSpec . NgramSpeculation other )
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( CodedInputStream input , ExtensionRegistryLite extensionRegistry )
Overrides
mergeFrom(Message other)
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( Message other )
Parameter
Name Description
otherMessage
Overrides
setNgramSize(int value)
public SpeculativeDecodingSpec . NgramSpeculation . Builder setNgramSize ( int value )
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
Parameter
Name Description
valueint The ngramSize to set.
Send feedback
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2026-03-30 UTC.
Need to tell us more?
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2026-03-30 UTC."],[],[]]
