[BUG] Different embedding 3 vectors in Azure vs. OpenAI #40243
Labels
customer-reported
Issues that are reported by GitHub users external to the Azure organization.
OpenAI
question
The issue doesn't require a change to the product in order to be resolved. Most issues start as that
Service Attention
This issue is responsible by Azure service team.
Describe the bug
When you request the same input, same api version, same model for text embedding large 3 in Azure vs. in OpenAI, you get slightly different results on the vector. They are small in floating values (< 0.0001), but in aggregate they are different enough to get bad ranking results when we mix the two together.
I don't see any documentation describing this behavior so I'm just asking here in case anyone from the Azure team knows an answer to this.
Exception or Stack Trace
See above
To Reproduce
See above
Code Snippet
Add the code snippet that causes the issue.
Expected behavior
The vectors should be exactly the same
Setup (please complete the following information):
n/a
Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report
The text was updated successfully, but these errors were encountered: