Skip to content

feat(ingest): add source aspect number in telemetry #13914

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jul 1, 2025

Conversation

anshbansal
Copy link
Collaborator

@anshbansal anshbansal commented Jul 1, 2025

Adding a print in telemetry confirmed the properties being passed after pipeline success is this

{'source_type': 'datahub-mock-data', 'source_aspects': {'dataset': {'status': 2, 'subTypes': 2, 'upstreamLineage': 2}}, 'sink_type': 'datahub-rest', 'transformer_types': [], 'records_written': 8, 'source_failures': 0, 'source_warnings': 0, 'sink_failures': 0, 'sink_warnings': 0, 'global_warnings': 0, 'failures': 0, 'warnings': 0, 'has_pipeline_name': False}

or

{'source_type': 'datahub-mock-data', 'source_aspects': {'dataset': {'status': 2, 'subTypes': 2, 'upstreamLineage': 1}}, 'sink_type': 'datahub-rest', 'transformer_types': [], 'records_written': 4, 'source_failures': 0, 'source_warnings': 0, 'sink_failures': 0, 'sink_warnings': 0, 'global_warnings': 0, 'failures': 0, 'warnings': 0, 'has_pipeline_name': False}

Copy link

codecov bot commented Jul 1, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

✅ All tests successful. No failed tests found.

📢 Thoughts on this report? Let us know!

@github-actions github-actions bot added the ingestion PR or Issue related to the ingestion of metadata label Jul 1, 2025
@anshbansal anshbansal changed the title feat(ingest): add source aspect number in telemtery feat(ingest): add source aspect number in telemetry Jul 1, 2025
@anshbansal anshbansal merged commit 1dab349 into master Jul 1, 2025
60 of 61 checks passed
@anshbansal anshbansal deleted the ab-2025-jul-01-send-stats branch July 1, 2025 13:38
kartikey-visa pushed a commit to kartikey-visa/datahub that referenced this pull request Jul 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ingestion PR or Issue related to the ingestion of metadata pending-submitter-merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants