-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Doc out of order issue from Lucene 8.10.1 #13338
Comments
Hi @SaiSatwik |
Hi @mkhludnev No. We have seen this issue in a VM where single node opensearch deployment is running. Due to this issue opensearch index went into RED state, leading to failure in any query on this index. |
Pardon. I had a wrong clue about a change in test framework occurring later. Now, looking into the version you mention, I realized, it's wrong. Have no idea. Don't you have index sorting configured? |
@mkhludnev , we do not have index sorting configured. But, could you please help me understand how can this issue could be related to index sorting configuration? |
honestly, have no idea. How many docs you have in this index? May it exceed 2bns? |
No. It would be hardly in thousands (max 50k). |
This log is scary: out-of-order doc IDs, doc freq greater than total term freq, there is a major issue here. Are you doing something exotic on this index? Can you replicate this bug consistently? If so, does it still replicate if you use a more modern JDK (trying to check if there could be a JDK bug). Or can you run with assertions enabled and see if it reports a problem earlier? |
Description
We are seeing docs out of order error multiple times on Opensearch 1.2.3. Seems issue is coming from lucene, but no clue what could be happening under the hood. No much significant spikes seen in disk i/o logs around the time of issue.
Version and environment details
Java Version:
lscpu output:
opensearch 1.2.3 is using lucene-core-8.10.1
The text was updated successfully, but these errors were encountered: