Skip to content

fix(ingest/presto): Presto/Trino property extraction fix #13487

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
May 12, 2025

Conversation

treff7es
Copy link
Contributor

@treff7es treff7es commented May 12, 2025

  1. Workaround for Presto to not fail on missing system column
    Unfortunately, the Presto dialect provides catalog_name as a column; therefore, we need a workaround to avoid failure.
    This is a workaround not to fail, which causes only the table comment to be returned as a property, which is still better than failing.

  2. Fix Trino property extraction from Iceberg tables

@github-actions github-actions bot added the ingestion PR or Issue related to the ingestion of metadata label May 12, 2025
Copy link

codecov bot commented May 12, 2025

Codecov Report

Attention: Patch coverage is 31.81818% with 15 lines in your changes missing coverage. Please review.

✅ All tests successful. No failed tests found.

Files with missing lines Patch % Lines
...gestion/src/datahub/ingestion/source/sql/presto.py 0.00% 8 Missing ⚠️
...ngestion/src/datahub/ingestion/source/sql/trino.py 50.00% 7 Missing ⚠️

❌ Your patch status has failed because the patch coverage (31.81%) is below the target coverage (75.00%). You can increase the patch coverage or adjust the target coverage.

📢 Thoughts on this report? Let us know!

@datahub-cyborg datahub-cyborg bot added the needs-review Label for PRs that need review from a maintainer. label May 12, 2025
@treff7es treff7es force-pushed the presto_catalog_name_workaround branch from 26ea1d0 to 5735636 Compare May 12, 2025 13:34
@treff7es treff7es changed the title fix(ingest/presto): workaround for Presto to not fail on missing system column fix(ingest/presto): Presto/Trino property extraction fix May 12, 2025
@datahub-cyborg datahub-cyborg bot added pending-submitter-merge and removed needs-review Label for PRs that need review from a maintainer. labels May 12, 2025
@treff7es treff7es merged commit 93c04ad into master May 12, 2025
61 of 62 checks passed
@treff7es treff7es deleted the presto_catalog_name_workaround branch May 12, 2025 20:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ingestion PR or Issue related to the ingestion of metadata pending-submitter-merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants