Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for deletion tracking in ClickHouse sink tables #231

Open
wants to merge 6 commits into
base: main
Choose a base branch
from

Conversation

laskoviymishka
Copy link
Contributor

@laskoviymishka laskoviymishka commented Feb 25, 2025

  • Introduce __data_transfer_is_deleted generated column for tracking deletions
  • Update ClickHouse destination model to support deletable flag
  • Extend sink parameters interface with IsDeleteable() method
  • Include is_deleted flag into replacing merge tree

Closes: #219

- Introduce `__data_transfer_is_deleted` generated column for tracking deletions
- Update ClickHouse destination model to support deletable flag
- Extend sink parameters interface with `IsDeleteable()` method
- Automatically derive deletable status from transfer options

Closes: #219
@laskoviymishka laskoviymishka marked this pull request as ready for review February 25, 2025 18:42
- Add `IsDeleteable` field to `ChSource` struct
- Implement `IsDeleteable()` method for `ChSourceWrapper`
- Add `ToSinkParams()` method to create a copy of source with deletable flag set to false by default
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Clickhouse/sink: deleted system column not used in shema
1 participant