Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GH-1433] No TDR temporary snapshots in tests #595

Merged
merged 1 commit into from
Mar 24, 2022

Conversation

okotsopoulos
Copy link
Contributor

Purpose

Previous work in this space: #561

I found this new improvement in my "stash graveyard".

In integration tests which interact with TDR, we don't actually have to create temporary snapshots within temporary datasets (and cross our fingers that developers won't use temporary snapshots within fixed datasets). You might remember that deleting a snapshot obtains an exclusive lock on the underlying dataset, which lead to flapping test failures on concurrent runs.

Instead, we can create snapshots as normal within temporary datasets: temporary datasets automatically delete any of their snapshots before the dataset.

Instead, we can rely on temporary datasets which automatically delete any of their snapshots before the dataset.
@@ -193,18 +193,6 @@
datarepo/delete-snapshots-then-dataset
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here's where we clean up any snapshots as part of cleaning up a temporary dataset.

(util/bracket
#(datarepo/create-snapshot snapshot-request)
datarepo/delete-snapshot
f))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks again.

@okotsopoulos okotsopoulos merged commit 8cbaf75 into develop Mar 24, 2022
@okotsopoulos okotsopoulos deleted the okotsopo/GH-1433-no-temp-snapshots branch March 24, 2022 15:40
okotsopoulos added a commit that referenced this pull request Apr 1, 2022
GH-1623 workloads/update-workload! should define own transactions (#597)
GH-1640 Broken Terra Submission links in completed workflow Slack messages (#598)
GH-1639 Pin jinja2 version for mkdocks compatibility (#596)
GH-1433 No TDR temporary snapshots in tests (#595)
GH-1619 Add workload info to sink logs (#594)
GH-1638 Disable link unfurling when Slacking watchers (#593)
okotsopoulos added a commit that referenced this pull request Apr 4, 2022
GH-1623 workloads/update-workload! should define own transactions (#597)
GH-1640 Broken Terra Submission links in completed workflow Slack messages (#598)
GH-1639 Pin jinja2 version for mkdocks compatibility (#596)
GH-1433 No TDR temporary snapshots in tests (#595)
GH-1619 Add workload info to sink logs (#594)
GH-1638 Disable link unfurling when Slacking watchers (#593)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants