OpenAIAssistantInvocationOptions.TopP Property
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Gets the probability mass of tokens whose results are considered in nucleus sampling.
[System.Text.Json.Serialization.JsonIgnore(Condition=System.Text.Json.Serialization.JsonIgnoreCondition.WhenWritingNull)]
public float? TopP { get; init; }[<System.Text.Json.Serialization.JsonIgnore(Condition=System.Text.Json.Serialization.JsonIgnoreCondition.WhenWritingNull)>]
member this.TopP : Nullable<single> with get, setPublic Property TopP As Nullable(Of Single)Property Value
- Attributes
Remarks
It's recommended to set this property or Temperature, but not both.
Nucleus sampling is an alternative to sampling with temperature where the model considers the results of the tokens with TopP probability mass. For example, 0.1 means only the tokens comprising the top 10% probability mass are considered.