Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add operations and applier to enable an exporter #18817

Merged
merged 9 commits into from
May 29, 2024

Conversation

deepthidevaki
Copy link
Contributor

@deepthidevaki deepthidevaki commented May 24, 2024

Description

This PR extends the state of exporter in the dynamic config with some additional metadata for enabling an exporter. When enabling the exporter, we can optionally provide the id of another exporter from which it can initialize its metadata from. The ExporterDirector should use this when enabling the exporter.

As discussed in the POC, there is a possibility that the exporter is disabled first, then re-enabled, then the node restarted. Since there was no snapshot in between, then restarted node will start with the exporter state before disabling. This is incorrect, because it was re-initialized with a different metadata. To allow detecting this case, we add a metadataVersion to the exporter state. This version is incremented everytime an exporter is enabled. The ExporterDirector can use this info to know whether the metadata in the runtime is up-to-date or not. The initial state for an already enabled exporter during cluster bootstrap will be 0.

This PR also adds the operation and applier for enabling an exporter. This follows the same approach all other configuration change operations.

Related issues

closes #18757
closes #18808

@github-actions github-actions bot added the component/zeebe Related to the Zeebe component/team label May 24, 2024
@deepthidevaki deepthidevaki marked this pull request as ready for review May 27, 2024 11:19
Copy link
Member

@npepinpe npepinpe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀 Looks good, I kept looking for usage of the metadata version, but I guess this will only be in the next PR 👍

@deepthidevaki deepthidevaki added this pull request to the merge queue May 29, 2024
Merged via the queue into main with commit e3bd733 May 29, 2024
38 checks passed
@deepthidevaki deepthidevaki deleted the dd-exporter-enable-operation branch May 29, 2024 13:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/zeebe Related to the Zeebe component/team
Projects
None yet
2 participants