Skip to content

Event Hubs, Offset not mapped properly from ReceivedEventData -> Checkpoint #6497

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
codynolf-cnhi opened this issue Apr 1, 2025 · 2 comments
Labels
customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that

Comments

@codynolf-cnhi
Copy link

Query/Question
I am struggling to understand why the offset from a ReceivedEventData is losing its value (changing from correct value to 0) when I invoke ProcessorPartitionClient::UpdateCheckpoint. I have created my own CheckpointStore (just writes local json file) which gets called from the ProcessorPartitionClient, all good here. The problem is when I get the Checkpoint object from the signature the offset is now 0 instead of the proper value. SequenceNumber is mapping properly.

I noticed this change which did confuse me at first until i noticed it was recent, but this should not matter as my local offset is Int64 type.

Am I going crazy? Or is something not working like it should here.

Before Calling UpdateCheckpoint:

Image

After UpdateCheckpoint is invoked and makes it way to my CheckpointStore implementation:

Image

Why is this not a Bug or a feature Request?
I am new to open source so I wanted to put a query in first for a sanity check before I open a bug.

Setup (please complete the following information if applicable):

  • OS: Windows WSL using .devcontainer -> mcr.microsoft.com/devcontainers/cpp:1-ubuntu-24.04)
  • IDE : vscode
  • Version of the Library used: 1.0.0-beta.10

Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

  • [ x] Query Added
  • [ x] Setup information Added
@github-actions github-actions bot added customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that labels Apr 1, 2025
@LarryOsterman
Copy link
Member

Thank you for your feedback.

FWIW, the "Offset" property has always been a string property - the Azure SDKs were incorrectly treating it as a numeric property, this has been fixed in all the existing Azure SDKs.

Looking at the code for UpdateCheckpoint, if the ReceivedEventMessage has both an Offset and a SequenceNumber, then both should be presented to the checkpoint store.

Can you verify that the ReceivedEventMessage has both attributes set?

@codynolf-cnhi
Copy link
Author

Hello, I appreciate the reply. Good to know about the Offset data type, I was only confused at first just because of the differences bewtween latest and my local.

As for your question Can you verify that the ReceivedEventMessage has both attributes set? Yes, it looks like both of these are set in the ReceivedEventMessage , I believe this is my first screenshot in the description. If you agree, I can double check this and put in a bug ticket if I can reproduce.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that
Projects
None yet
Development

No branches or pull requests

2 participants