Skip to content

Conversation

@m-abulazm
Copy link
Contributor

@m-abulazm m-abulazm commented Jan 9, 2026

Acceptance CI does not run all the tests it should run, tests under integration, that is why we didn't notice breaking integration tests as they did not run.

@codecov
Copy link

codecov bot commented Jan 9, 2026

Codecov Report

❌ Patch coverage is 0% with 2 lines in your changes missing coverage. Please review.
✅ Project coverage is 64.05%. Comparing base (25312ad) to head (3e8dcad).

Files with missing lines Patch % Lines
...abricks/labs/lakebridge/reconcile/recon_capture.py 0.00% 2 Missing ⚠️
Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2223   +/-   ##
=======================================
  Coverage   64.05%   64.05%           
=======================================
  Files         100      100           
  Lines        8624     8624           
  Branches      893      893           
=======================================
  Hits         5524     5524           
  Misses       2928     2928           
  Partials      172      172           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@github-actions
Copy link

github-actions bot commented Jan 9, 2026

❌ 118/129 passed, 10 flaky, 11 failed, 5 skipped, 9m13s total

❌ test_reconcile_data_without_mismatches_and_missing: databricks.labs.lakebridge.reconcile.exception.DataSourceRuntimeException: Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception (2.667s)
databricks.labs.lakebridge.reconcile.exception.DataSourceRuntimeException: Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
[gw7] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey_t` AS `s_nationkey`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey_t` AS `s_nationkey`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
[gw7] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
❌ test_reconcile_data_with_mismatch_and_no_missing: databricks.labs.lakebridge.reconcile.exception.DataSourceRuntimeException: Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception (1.159s)
databricks.labs.lakebridge.reconcile.exception.DataSourceRuntimeException: Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
[gw7] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey_t` AS `s_nationkey`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey_t` AS `s_nationkey`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
[gw7] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
❌ test_reconcile_data_missing_and_no_mismatch: databricks.labs.lakebridge.reconcile.exception.DataSourceRuntimeException: Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception (1.246s)
databricks.labs.lakebridge.reconcile.exception.DataSourceRuntimeException: Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
[gw7] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey_t` AS `s_nationkey`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey_t` AS `s_nationkey`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
[gw7] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
❌ test_reconcile_data_with_threshold_and_row_report_type: databricks.labs.lakebridge.reconcile.exception.DataSourceRuntimeException: Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, TRIM(s_address) AS `s_address`, TRIM(s_name) AS `s_name`, `s_nationkey` AS `s_nationkey`, TRIM(s_phone) AS `s_phone`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception (91ms)
databricks.labs.lakebridge.reconcile.exception.DataSourceRuntimeException: Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, TRIM(s_address) AS `s_address`, TRIM(s_name) AS `s_name`, `s_nationkey` AS `s_nationkey`, TRIM(s_phone) AS `s_phone`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
[gw7] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, TRIM(s_address) AS `s_address`, TRIM(s_name) AS `s_name`, `s_nationkey` AS `s_nationkey`, TRIM(s_phone) AS `s_phone`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, TRIM(s_address_t) AS `s_address`, TRIM(s_name) AS `s_name`, `s_nationkey_t` AS `s_nationkey`, TRIM(s_phone_t) AS `s_phone`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, TRIM(s_address) AS `s_address`, TRIM(s_name) AS `s_name`, `s_nationkey` AS `s_nationkey`, TRIM(s_phone) AS `s_phone`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, TRIM(s_address) AS `s_address`, TRIM(s_name) AS `s_name`, `s_nationkey` AS `s_nationkey`, TRIM(s_phone) AS `s_phone`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, TRIM(s_address_t) AS `s_address`, TRIM(s_name) AS `s_name`, `s_nationkey_t` AS `s_nationkey`, TRIM(s_phone_t) AS `s_phone`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, TRIM(s_address) AS `s_address`, TRIM(s_name) AS `s_name`, `s_nationkey` AS `s_nationkey`, TRIM(s_phone) AS `s_phone`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
[gw7] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
❌ test_recon_for_report_type_is_data: databricks.labs.lakebridge.reconcile.exception.ReconciliationException: (' Reconciliation failed for one or more tables. Please check the recon metrics for more details. **reconcile** failed.', ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), _null_recon_) || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), _null_recon_), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = t AND s_address = a) : Mock Exception')])) (6.543s)
databricks.labs.lakebridge.reconcile.exception.ReconciliationException: (' Reconciliation failed for one or more tables. Please check the recon metrics for more details. **reconcile** failed.', ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), _null_recon_) || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), _null_recon_), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = t AND s_address = a) : Mock Exception')]))
[gw3] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] report_type: data, data_source: databricks 
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey_t` AS `s_nationkey`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] Reconciliation for 'data' report completed.
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for source: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for target: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_a52f0b6aa64846dfb1bac6293b0fef9a.main successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_a52f0b6aa64846dfb1bac6293b0fef9a.metrics successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Final reconcile output: ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), _null_recon_) || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), _null_recon_), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = t AND s_address = a) : Mock Exception')])
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] report_type: data, data_source: databricks 
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey_t` AS `s_nationkey`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] Reconciliation for 'data' report completed.
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for source: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for target: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_a52f0b6aa64846dfb1bac6293b0fef9a.main successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_a52f0b6aa64846dfb1bac6293b0fef9a.metrics successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Final reconcile output: ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), _null_recon_) || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), _null_recon_), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = t AND s_address = a) : Mock Exception')])
[gw3] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
❌ test_schema_recon_with_data_source_exception: databricks.labs.lakebridge.reconcile.exception.ReconciliationException: (' Reconciliation failed for one or more tables. Please check the recon metrics for more details. **reconcile** failed.', ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Runtime exception occurred while fetching schema using (org, data, supplier) : Mock Exception')])) (4.249s)
databricks.labs.lakebridge.reconcile.exception.ReconciliationException: (' Reconciliation failed for one or more tables. Please check the recon metrics for more details. **reconcile** failed.', ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Runtime exception occurred while fetching schema using (org, data, supplier) : Mock Exception')]))
[gw4] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] report_type: schema, data_source: snowflake 
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching schema using (org, data, supplier) : Mock Exception
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_a1f7bee874bd46bea7c8a392fc5ac222.main successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_a1f7bee874bd46bea7c8a392fc5ac222.metrics successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Final reconcile output: ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Runtime exception occurred while fetching schema using (org, data, supplier) : Mock Exception')])
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] report_type: schema, data_source: snowflake 
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching schema using (org, data, supplier) : Mock Exception
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_a1f7bee874bd46bea7c8a392fc5ac222.main successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_a1f7bee874bd46bea7c8a392fc5ac222.metrics successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Final reconcile output: ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Runtime exception occurred while fetching schema using (org, data, supplier) : Mock Exception')])
[gw4] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
❌ test_schema_recon_with_general_exception: databricks.labs.lakebridge.reconcile.exception.ReconciliationException: (' Reconciliation failed for one or more tables. Please check the recon metrics for more details. **reconcile** failed.', ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Unknown Error')])) (2.708s)
databricks.labs.lakebridge.reconcile.exception.ReconciliationException: (' Reconciliation failed for one or more tables. Please check the recon metrics for more details. **reconcile** failed.', ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Unknown Error')]))
[gw4] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] report_type: schema, data_source: snowflake 
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] Schema comparison is completed.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_1ccbbf0a39f6484689f85bc88560aef9.main successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_1ccbbf0a39f6484689f85bc88560aef9.metrics successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Final reconcile output: ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Unknown Error')])
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] report_type: schema, data_source: snowflake 
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] Schema comparison is completed.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_1ccbbf0a39f6484689f85bc88560aef9.main successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_1ccbbf0a39f6484689f85bc88560aef9.metrics successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Final reconcile output: ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Unknown Error')])
[gw4] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
❌ test_data_recon_with_general_exception: databricks.labs.lakebridge.reconcile.exception.ReconciliationException: (' Reconciliation failed for one or more tables. Please check the recon metrics for more details. **reconcile** failed.', ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Unknown Error')])) (3.519s)
databricks.labs.lakebridge.reconcile.exception.ReconciliationException: (' Reconciliation failed for one or more tables. Please check the recon metrics for more details. **reconcile** failed.', ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Unknown Error')]))
[gw6] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] report_type: data, data_source: snowflake 
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] Reconciliation for 'data' report completed.
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for source: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for target: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_0e7f456652564a92b1fa0db04bcc7b43.main successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_0e7f456652564a92b1fa0db04bcc7b43.metrics successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Final reconcile output: ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Unknown Error')])
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] report_type: data, data_source: snowflake 
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] Reconciliation for 'data' report completed.
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for source: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for target: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_0e7f456652564a92b1fa0db04bcc7b43.main successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_0e7f456652564a92b1fa0db04bcc7b43.metrics successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Final reconcile output: ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Unknown Error')])
[gw6] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
❌ test_data_recon_with_source_exception: databricks.labs.lakebridge.reconcile.exception.ReconciliationException: (' Reconciliation failed for one or more tables. Please check the recon metrics for more details. **reconcile** failed.', ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Source Runtime Error')])) (3.316s)
databricks.labs.lakebridge.reconcile.exception.ReconciliationException: (' Reconciliation failed for one or more tables. Please check the recon metrics for more details. **reconcile** failed.', ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Source Runtime Error')]))
[gw6] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] report_type: data, data_source: snowflake 
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] Reconciliation for 'data' report completed.
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for source: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for target: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_db30c044dbfa4bfe8b57891e0a25263c.main successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_db30c044dbfa4bfe8b57891e0a25263c.metrics successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Final reconcile output: ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Source Runtime Error')])
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] report_type: data, data_source: snowflake 
14:55 INFO [databricks.labs.lakebridge.reconcile.trigger_recon_service] Reconciliation for 'data' report completed.
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for source: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.count_query] Record Count Query for target: SELECT COUNT(1) AS count FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_db30c044dbfa4bfe8b57891e0a25263c.main successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Data written to recon_schema_db30c044dbfa4bfe8b57891e0a25263c.metrics successfully.
14:55 INFO [databricks.labs.lakebridge.reconcile.recon_capture] Final reconcile output: ReconcileOutput(recon_id='00112233-4455-6677-8899-aabbccddeeff', results=[ReconcileTableOutput(target_table_name='org.data.target_supplier', source_table_name='org.data.supplier', status=StatusOutput(row=None, column=None, schema=None, aggregate=None), exception_message='Source Runtime Error')])
[gw6] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
❌ test_reconcile_data_with_mismatches_and_missing: databricks.labs.lakebridge.reconcile.exception.DataSourceRuntimeException: Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception (8.667s)
databricks.labs.lakebridge.reconcile.exception.DataSourceRuntimeException: Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
[gw8] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey_t` AS `s_nationkey`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for source: SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a'
14:55 INFO [databricks.labs.lakebridge.reconcile.query_builder.hash_query] Hash Query for target: SELECT LOWER(SHA2(TRIM(s_address_t) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey_t`), '_null_recon_') || TRIM(s_phone_t) || COALESCE(TRIM(`s_suppkey_t`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey_t` AS `s_nationkey`, `s_suppkey_t` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address_t = 'a'
14:55 WARNING [databricks.labs.lakebridge.reconcile.connectors.data_source] Runtime exception occurred while fetching data using (org, data, SELECT LOWER(SHA2(TRIM(s_address) || TRIM(s_name) || COALESCE(TRIM(`s_nationkey`), '_null_recon_') || TRIM(s_phone) || COALESCE(TRIM(`s_suppkey`), '_null_recon_'), 256)) AS hash_value_recon, `s_nationkey` AS `s_nationkey`, `s_suppkey` AS `s_suppkey` FROM :tbl WHERE s_name = 't' AND s_address = 'a') : Mock Exception
[gw8] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
❌ test_recon_databricks_job_succeeds: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task run_reconciliation failed with message: Workload failed, see run output for details. (1m18.374s)
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task run_reconciliation failed with message: Workload failed, see run output for details.
14:55 INFO [tests.integration.reconcile.test_recon_databricks] Setting up application context for recon tests
14:55 INFO [tests.integration.reconcile.test_recon_databricks] Installing app and recon configuration into workspace
14:55 WARNING [databricks.labs.blueprint.wheels] Cannot determine unreleased version. This can be fixed by adding  `git fetch --prune --unshallow` to your CI configuration.
Traceback (most recent call last):
  File "/home/runner/work/lakebridge/lakebridge/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/wheels.py", line 115, in unreleased_version
    out = subprocess.run(
  File "/opt/hostedtoolcache/Python/3.10.19/x64/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['git', 'describe', '--tags']' returned non-zero exit status 128.
14:56 INFO [databricks.labs.lakebridge.install] Installing Lakebridge reconcile Metadata components.
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Installing reconcile components.
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Deploying reconciliation metadata tables.
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table main in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table metric in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table detai in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table aggregate_metric in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table aggregate_detai in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table aggregate_rule in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Deploying reconciliation dashboards.
14:56 INFO [databricks.labs.lakebridge.deployment.dashboard] Deploying dashboards from base folder /home/runner/work/lakebridge/lakebridge/src/databricks/labs/lakebridge/resources/reconcile/dashboards
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 INFO [databricks.labs.lakebridge.deployment.dashboard] Dashboard deployed with URL: https://DATABRICKS_HOST/sql/dashboardsv3/01f0efc6d5fa1e46baad102e1a58eb2f
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 INFO [databricks.labs.lakebridge.deployment.dashboard] Dashboard deployed with URL: https://DATABRICKS_HOST/sql/dashboardsv3/01f0efc6d6f217b88e219ca3a03201cf
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Deploying reconciliation jobs.
14:56 INFO [databricks.labs.lakebridge.deployment.job] Deploying reconciliation job.
14:56 WARNING [databricks.labs.lakebridge.deployment.job] Parsed package name databricks_labs_lakebridge does not match product name, using TEST_SCHEMA.
14:56 INFO [databricks.labs.lakebridge.deployment.job] Creating new job configuration for job `Reconciliation Runner`
14:56 INFO [databricks.labs.lakebridge.deployment.job] Reconciliation job deployed with job_id=891363337712328
14:56 INFO [databricks.labs.lakebridge.deployment.job] Job URL: https://DATABRICKS_HOST#job/891363337712328
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Installation of reconcile components completed successfully.
14:56 INFO [tests.integration.reconcile.test_recon_databricks] Application context setup complete for recon tests
[gw4] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python
14:55 INFO [tests.integration.reconcile.test_recon_databricks] Setting up application context for recon tests
14:55 INFO [tests.integration.reconcile.test_recon_databricks] Installing app and recon configuration into workspace
14:55 WARNING [databricks.labs.blueprint.wheels] Cannot determine unreleased version. This can be fixed by adding  `git fetch --prune --unshallow` to your CI configuration.
Traceback (most recent call last):
  File "/home/runner/work/lakebridge/lakebridge/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/wheels.py", line 115, in unreleased_version
    out = subprocess.run(
  File "/opt/hostedtoolcache/Python/3.10.19/x64/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['git', 'describe', '--tags']' returned non-zero exit status 128.
14:56 INFO [databricks.labs.lakebridge.install] Installing Lakebridge reconcile Metadata components.
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Installing reconcile components.
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Deploying reconciliation metadata tables.
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table main in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table metric in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table detai in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table aggregate_metric in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table aggregate_detai in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table aggregate_rule in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Deploying reconciliation dashboards.
14:56 INFO [databricks.labs.lakebridge.deployment.dashboard] Deploying dashboards from base folder /home/runner/work/lakebridge/lakebridge/src/databricks/labs/lakebridge/resources/reconcile/dashboards
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 INFO [databricks.labs.lakebridge.deployment.dashboard] Dashboard deployed with URL: https://DATABRICKS_HOST/sql/dashboardsv3/01f0efc6d5fa1e46baad102e1a58eb2f
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 INFO [databricks.labs.lakebridge.deployment.dashboard] Dashboard deployed with URL: https://DATABRICKS_HOST/sql/dashboardsv3/01f0efc6d6f217b88e219ca3a03201cf
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Deploying reconciliation jobs.
14:56 INFO [databricks.labs.lakebridge.deployment.job] Deploying reconciliation job.
14:56 WARNING [databricks.labs.lakebridge.deployment.job] Parsed package name databricks_labs_lakebridge does not match product name, using TEST_SCHEMA.
14:56 INFO [databricks.labs.lakebridge.deployment.job] Creating new job configuration for job `Reconciliation Runner`
14:56 INFO [databricks.labs.lakebridge.deployment.job] Reconciliation job deployed with job_id=891363337712328
14:56 INFO [databricks.labs.lakebridge.deployment.job] Job URL: https://DATABRICKS_HOST#job/891363337712328
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Installation of reconcile components completed successfully.
14:56 INFO [tests.integration.reconcile.test_recon_databricks] Application context setup complete for recon tests
14:56 INFO [databricks.labs.lakebridge.reconcile.runner] Triggering the reconcile job with job_id: `891363337712328`
14:56 INFO [databricks.labs.lakebridge.reconcile.runner] 'RECONCILE' job started. Please check the job_url `https://DATABRICKS_HOST/jobs/891363337712328/runs/225010363055903` for the current status.
14:55 INFO [tests.integration.reconcile.test_recon_databricks] Setting up application context for recon tests
14:55 INFO [tests.integration.reconcile.test_recon_databricks] Installing app and recon configuration into workspace
14:55 WARNING [databricks.labs.blueprint.wheels] Cannot determine unreleased version. This can be fixed by adding  `git fetch --prune --unshallow` to your CI configuration.
Traceback (most recent call last):
  File "/home/runner/work/lakebridge/lakebridge/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/wheels.py", line 115, in unreleased_version
    out = subprocess.run(
  File "/opt/hostedtoolcache/Python/3.10.19/x64/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['git', 'describe', '--tags']' returned non-zero exit status 128.
14:56 INFO [databricks.labs.lakebridge.install] Installing Lakebridge reconcile Metadata components.
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Installing reconcile components.
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Deploying reconciliation metadata tables.
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table main in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table metric in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table detai in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table aggregate_metric in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table aggregate_detai in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.table] Deploying table aggregate_rule in dummy_cfid4n97e.dummy_sytwgk6mj
14:56 INFO [databricks.labs.lakebridge.deployment.table] SQL Backend used for deploying table: StatementExecutionBackend
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Deploying reconciliation dashboards.
14:56 INFO [databricks.labs.lakebridge.deployment.dashboard] Deploying dashboards from base folder /home/runner/work/lakebridge/lakebridge/src/databricks/labs/lakebridge/resources/reconcile/dashboards
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 INFO [databricks.labs.lakebridge.deployment.dashboard] Dashboard deployed with URL: https://DATABRICKS_HOST/sql/dashboardsv3/01f0efc6d5fa1e46baad102e1a58eb2f
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 WARNING [databricks.labs.lsql.dashboards] Parsing : No expression was parsed from ''
14:56 INFO [databricks.labs.lakebridge.deployment.dashboard] Dashboard deployed with URL: https://DATABRICKS_HOST/sql/dashboardsv3/01f0efc6d6f217b88e219ca3a03201cf
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Deploying reconciliation jobs.
14:56 INFO [databricks.labs.lakebridge.deployment.job] Deploying reconciliation job.
14:56 WARNING [databricks.labs.lakebridge.deployment.job] Parsed package name databricks_labs_lakebridge does not match product name, using TEST_SCHEMA.
14:56 INFO [databricks.labs.lakebridge.deployment.job] Creating new job configuration for job `Reconciliation Runner`
14:56 INFO [databricks.labs.lakebridge.deployment.job] Reconciliation job deployed with job_id=891363337712328
14:56 INFO [databricks.labs.lakebridge.deployment.job] Job URL: https://DATABRICKS_HOST#job/891363337712328
14:56 INFO [databricks.labs.lakebridge.deployment.recon] Installation of reconcile components completed successfully.
14:56 INFO [tests.integration.reconcile.test_recon_databricks] Application context setup complete for recon tests
14:56 INFO [databricks.labs.lakebridge.reconcile.runner] Triggering the reconcile job with job_id: `891363337712328`
14:56 INFO [databricks.labs.lakebridge.reconcile.runner] 'RECONCILE' job started. Please check the job_url `https://DATABRICKS_HOST/jobs/891363337712328/runs/225010363055903` for the current status.
14:57 INFO [tests.integration.reconcile.test_recon_databricks] Tearing down application context for recon tests
14:57 INFO [databricks.labs.lakebridge.install] Uninstalling Lakebridge from https://DATABRICKS_HOST.
14:57 INFO [databricks.labs.lakebridge.deployment.recon] Uninstalling reconcile components.
14:57 INFO [databricks.labs.lakebridge.deployment.recon] Removing reconciliation dashboards.
14:57 INFO [databricks.labs.lakebridge.deployment.recon] Removing dashboard with id=01f0efc6d5fa1e46baad102e1a58eb2f.
14:57 INFO [databricks.labs.lakebridge.deployment.recon] Removing dashboard with id=01f0efc6d6f217b88e219ca3a03201cf.
14:57 INFO [databricks.labs.lakebridge.deployment.recon] Removing Reconciliation Jobs.
14:57 INFO [databricks.labs.lakebridge.deployment.recon] Removing job Reconciliation Runner with job_id=891363337712328.
14:57 INFO [databricks.labs.lakebridge.install] Uninstallation completed successfully.
14:57 INFO [tests.integration.reconcile.test_recon_databricks] Application context teardown complete for recon tests
[gw4] linux -- Python 3.10.19 /home/runner/work/lakebridge/lakebridge/.venv/bin/python

Flaky tests:

  • 🤪 test_installs_and_runs_local_bladebridge (18.588s)
  • 🤪 test_generate_final_reconcile_output_schema (7.618s)
  • 🤪 test_generate_final_reconcile_output_all (7.478s)
  • 🤪 test_installs_and_runs_pypi_bladebridge (20.034s)
  • 🤪 test_transpiles_informatica_to_sparksql_non_interactive[True] (17.549s)
  • 🤪 test_transpiles_informatica_to_sparksql (18.341s)
  • 🤪 test_transpiles_informatica_to_sparksql_non_interactive[False] (17.386s)
  • 🤪 test_transpile_teradata_sql (6.451s)
  • 🤪 test_transpile_teradata_sql_non_interactive[True] (5.992s)
  • 🤪 test_transpile_teradata_sql_non_interactive[False] (18.44s)

Running from acceptance #3361

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants