Skip to content

feat(ingest/dbt): fallback to schema from graph #13438

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

hsheth2
Copy link
Collaborator

@hsheth2 hsheth2 commented May 6, 2025

Stacked on top of #13436

@github-actions github-actions bot added the ingestion PR or Issue related to the ingestion of metadata label May 6, 2025
Copy link

codecov bot commented May 6, 2025

Codecov Report

Attention: Patch coverage is 71.87500% with 9 lines in your changes missing coverage. Please review.

✅ All tests successful. No failed tests found.

Files with missing lines Patch % Lines
...etadata-ingestion/src/datahub/utilities/mapping.py 70.00% 9 Missing ⚠️

📢 Thoughts on this report? Let us know!

Copy link

alwaysmeticulous bot commented May 6, 2025

✅ Meticulous spotted 0 visual differences across 1261 screens tested: view results.

Meticulous evaluated ~12 hours of user flows against your PR.

Expected differences? Click here. Last updated for commit 077f996. This comment will update as new commits are pushed.

# If we don't have a schema for this node from the dbt catalog
# and were unable to infer it (e.g. for sources), then we use
# the schema from the graph.
node.columns_setdefault(schema_fields)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We may have a debug log trace here and maybe a counter in the report.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Regarding updates in the OperatorProcessor: I left comments on the stacked PR

@datahub-cyborg datahub-cyborg bot added pending-submitter-response Issue/request has been reviewed but requires a response from the submitter and removed needs-review Label for PRs that need review from a maintainer. labels May 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ingestion PR or Issue related to the ingestion of metadata pending-submitter-response Issue/request has been reviewed but requires a response from the submitter
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants