Adding Logprobs in Chat completion response

[soetedja]

Hi,

Will the lmstudio chat completion response be added to a logprobs in the response?

Currently, when using OpenAI in .NET library the CreateChatCompletionResponseChoices
the logprobs is a required property and will result in an error.

    [global::System.Text.Json.Serialization.JsonPropertyName("logprobs")]
    [global::System.Text.Json.Serialization.JsonRequired]
    public required global::OpenAI.CreateChatCompletionResponseChoicesLogprobs? Logprobs { get; set; }

Thank you.

[stygmate]

+1 as it will permit to evaluate confiance score

[CarloNicolini]

Logprobs are still not available in the response.choices[0] output with LMStudio 0.3.5, despite the fact that no error are thrown when logprobs=True is passed.
Any idea if it will be part of a next release?

[stygmate]

+232 for this feature 😅

[Nayjest]

+1