Feature/build sync statistics and duration model - #198
Conversation
Adds the fivetran_platform__sync_metrics model, returning one record per completed sync (sync_stats log event) with extract/process/load timing and volume, total duration, and total records modified, enriched with connection and destination details. Includes yml docs, seed data, row-count integrity test, and README/CHANGELOG/quickstart entries. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
de37bc9 to
605d637
Compare
fivetran-avinash
left a comment
fivetran-avinash
left a comment
There was a problem hiding this comment.
@fivetran-savage A few comments before merge!
| @@ -1,5 +1,14 @@ | |||
| # dbt_fivetran_log v2.6.0 | |||
|
|
|||
| [PR #198](https://github.com/fivetran/dbt_fivetran_log/pull/198) includes the following update: | |||
There was a problem hiding this comment.
Looks like you have multiple PRs in this release. Can you update the PR to the release branch PR link and combine the Schema/Data change entires below.
There was a problem hiding this comment.
There is going to be a final review before the release branch is merged into main, so this review is just to merge this branch into the release branch. There will be another one or two branches being merged in before the final review, so I will clean up the full changelog/PR at that point.
| # dbt_fivetran_log v2.6.0 | ||
|
|
||
| [PR #198](https://github.com/fivetran/dbt_fivetran_log/pull/198) includes the following update: | ||
|
|
There was a problem hiding this comment.
Not relevant to this PR but we should probably add the following somewhere in this release CHANGELOG entry.
- The new variables
fivetran_platform_using_audit_trailandfivetran_platform_using_transformationsand linked to the relevant README section on how to configure/notes on how it works with Quickstart. - Links to the models like you have in the other schema/data changes for
fivetran_platform__errors_and_warningsandstg_fivetran_platform__connector_sdk_log
There was a problem hiding this comment.
Changelog will need a full audit/cleanup before merging into main.
| @@ -0,0 +1,23 @@ | |||
| {{ config( | |||
There was a problem hiding this comment.
We should probably add a new consistency test as well for this end model for future id checks.
Also looks as if audit_trail_enriched could use one as well.
fivetran-avinash
left a comment
fivetran-avinash
left a comment
There was a problem hiding this comment.
@fivetran-savage Approved to merge into your release branch
2 participants
fivetran_platform__sync_metricsmodel, which returns one record per completed ssync_statslog event, combining each sync's extract, process, load timing and volume statistics with its total duration and total records modified, enriched with connection and destination details.