public sealed class SpeculativeDecodingSpec.Types.DraftModelSpeculation : IMessage<SpeculativeDecodingSpec.Types.DraftModelSpeculation>, IEquatable<SpeculativeDecodingSpec.Types.DraftModelSpeculation>, IDeepCloneable<SpeculativeDecodingSpec.Types.DraftModelSpeculation>, IBufferMessage, IMessageReference documentation and code samples for the Vertex AI v1beta1 API class SpeculativeDecodingSpec.Types.DraftModelSpeculation.
Draft model speculation works by using the smaller model to generate candidate tokens for speculative decoding.
Implements
IMessageSpeculativeDecodingSpecTypesDraftModelSpeculation, IEquatableSpeculativeDecodingSpecTypesDraftModelSpeculation, IDeepCloneableSpeculativeDecodingSpecTypesDraftModelSpeculation, IBufferMessage, IMessageNamespace
Google.Cloud.AIPlatform.V1Beta1Assembly
Google.Cloud.AIPlatform.V1Beta1.dll
Constructors
DraftModelSpeculation()
public DraftModelSpeculation()DraftModelSpeculation(DraftModelSpeculation)
public DraftModelSpeculation(SpeculativeDecodingSpec.Types.DraftModelSpeculation other)| Parameter | |
|---|---|
| Name | Description |
other |
SpeculativeDecodingSpecTypesDraftModelSpeculation |
Properties
DraftModel
public string DraftModel { get; set; }Required. The resource name of the draft model.
| Property Value | |
|---|---|
| Type | Description |
string |
|
DraftModelAsModelName
public ModelName DraftModelAsModelName { get; set; }ModelName-typed view over the DraftModel resource name property.
| Property Value | |
|---|---|
| Type | Description |
ModelName |
|