Skip to content

[FLINK-39785][table] Add e2e tests for LateralSnapshotJoin#28713

Open
fhueske wants to merge 3 commits into
apache:masterfrom
confluentinc:fhueske-FLINK-39785-Add-LATERAL-SNAPSHOT-e2e-tests
Open

[FLINK-39785][table] Add e2e tests for LateralSnapshotJoin#28713
fhueske wants to merge 3 commits into
apache:masterfrom
confluentinc:fhueske-FLINK-39785-Add-LATERAL-SNAPSHOT-e2e-tests

Conversation

@fhueske

@fhueske fhueske commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

What is the purpose of the change

This PR adds end-2-end and restore tests for the LATERAL SNAPSHOT join.

Brief change log

  • adds support to control record emission delays to FromElementSourceFunctionWithWatermark
    • config options were already implement but not forwarded to all source functions
  • adds support to trigger savepoints by source emitted row count to RestoreTestBase
  • add LateralSnapshotJoinITCase
  • add LateralSnapshotJoinTestPrograms

Verifying this change

This is a tests-only PR.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
  • The S3 file system connector: no

Documentation

  • Does this pull request introduce a new feature? no
  • If yes, how is the feature documented? n/a

Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)

Generated-by: Claude Code 2.1.200 (Opus 4.8)

@fhueske fhueske marked this pull request as ready for review July 10, 2026 17:46
@flinkbot

flinkbot commented Jul 10, 2026

Copy link
Copy Markdown
Collaborator

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

@airlock-confluentinc airlock-confluentinc Bot force-pushed the fhueske-FLINK-39785-Add-LATERAL-SNAPSHOT-e2e-tests branch 2 times, most recently from f1cd480 to 59a64df Compare July 15, 2026 08:19
fhueske added 3 commits July 15, 2026 20:00
…h-down source

Wire the existing source.sleep-after-elements / source.sleep-time options into TestValuesScanTableSourceWithWatermarkPushDown

Generated-By: Claude Opus 4.8 (1M context)
…st framework

Lets restore tests take the stop-with-savepoint at a point defined by an
input-side signal rather than sink output, so operators that emit nothing at
the point of interest can be captured.

* RestoreTestBase: extract the trigger into an overridable awaitSavepointReady
  (default unchanged: waits for sinks to reach their before-restore rows) and
  retry stop-with-savepoint while the job is not yet fully running.
* TestValues watermark-push-down NewSource: add a per-table emission barrier
  (TestValuesTableFactory#awaitSourceEmitted) completed as rows are emitted.

Generated-By: Claude Opus 4.8 (1M context)
Adds end-to-end coverage for the LATERAL SNAPSHOT processing-time temporal join:

* LateralSnapshotJoinITCase: result tests over HEAP and ROCKSDB backends covering different configurations and input scenarios
* LateralSnapshotJoinRestoreTest / LateralSnapshotJoinTestPrograms: savepoint restore tests

Generated-By: Claude Opus 4.8 (1M context)
@airlock-confluentinc airlock-confluentinc Bot force-pushed the fhueske-FLINK-39785-Add-LATERAL-SNAPSHOT-e2e-tests branch from 59a64df to 7209fe0 Compare July 15, 2026 18:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants