You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When using Azure OpenAI, the 'usage' metadata is always returned as empty in the stream().
I understand that 'usage' is supported in the latest OpenAIServiceVersion, V2024_08_01_PREVIEW. Therefore, the AzureOpenAiChatOptions should also support the withStreamUsage() method to align with this.
The text was updated successfully, but these errors were encountered:
This is my first PR for Spring projects, please feel free to review and share any feedback or suggestions for improvement. I’m open to making adjustments as needed.
When using Azure OpenAI, the 'usage' metadata is always returned as empty in the stream().
I understand that 'usage' is supported in the latest OpenAIServiceVersion, V2024_08_01_PREVIEW. Therefore, the AzureOpenAiChatOptions should also support the withStreamUsage() method to align with this.
The text was updated successfully, but these errors were encountered: