Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

revert contention-reducing change in destination-snowflake #38052

Conversation

stephane-airbyte
Copy link
Contributor

@stephane-airbyte stephane-airbyte commented May 7, 2024

as part of the move of destination-snowflake to the kotlin CDK, we tried improve concurrency by only DELETEing from _airbyte_destination_state if it has some data to delete (by issuing an IF EXISTS in the same transaction.
Looks like it might be causing some stuck syncs, so we're reverting that "improvement"

Copy link

vercel bot commented May 7, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback May 8, 2024 4:59pm

@octavia-squidington-iii octavia-squidington-iii added the area/connectors Connector related issues label May 7, 2024
Copy link
Contributor Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @stephane-airbyte and the rest of your teammates on Graphite Graphite

@stephane-airbyte stephane-airbyte marked this pull request as ready for review May 7, 2024 23:10
@stephane-airbyte stephane-airbyte requested a review from a team as a code owner May 7, 2024 23:10
@stephane-airbyte stephane-airbyte changed the title revert contention-reducing change in snwoflake-destination revert contention-reducing change in destination-snowflake May 7, 2024
@stephane-airbyte stephane-airbyte force-pushed the stephane/05-07-revert_contention-reducing_change_in_snwoflake-destination branch from 9e461a6 to 7350506 Compare May 7, 2024 23:13
@octavia-squidington-iii octavia-squidington-iii added the area/documentation Improvements or additions to documentation label May 7, 2024
@stephane-airbyte stephane-airbyte force-pushed the stephane/05-07-revert_contention-reducing_change_in_snwoflake-destination branch from 7350506 to fba9806 Compare May 7, 2024 23:15
@stephane-airbyte stephane-airbyte force-pushed the stephane/05-07-revert_contention-reducing_change_in_snwoflake-destination branch from fba9806 to bfb3f64 Compare May 7, 2024 23:36
@edgao
Copy link
Contributor

edgao commented May 8, 2024

Nonblocking: I wonder if we can revert b69eae7 after this pr 🤔

@stephane-airbyte stephane-airbyte force-pushed the stephane/05-07-revert_contention-reducing_change_in_snwoflake-destination branch from bfb3f64 to a226aeb Compare May 8, 2024 15:45
@stephane-airbyte stephane-airbyte requested a review from a team as a code owner May 8, 2024 15:45
@octavia-squidington-iii octavia-squidington-iii added the CDK Connector Development Kit label May 8, 2024
@stephane-airbyte stephane-airbyte force-pushed the stephane/05-07-revert_contention-reducing_change_in_snwoflake-destination branch 2 times, most recently from 16ab3e9 to 29b1bcb Compare May 8, 2024 15:51
@stephane-airbyte stephane-airbyte force-pushed the stephane/05-07-revert_contention-reducing_change_in_snwoflake-destination branch from 29b1bcb to cc9aa23 Compare May 8, 2024 16:38
@stephane-airbyte stephane-airbyte force-pushed the stephane/05-07-revert_contention-reducing_change_in_snwoflake-destination branch from cc9aa23 to 40a1f1a Compare May 8, 2024 16:55
@stephane-airbyte stephane-airbyte merged commit 16ed6bf into master May 8, 2024
35 checks passed
@stephane-airbyte stephane-airbyte deleted the stephane/05-07-revert_contention-reducing_change_in_snwoflake-destination branch May 8, 2024 18:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation CDK Connector Development Kit connectors/destination/snowflake
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants