Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: document pruning scripts #1645

Merged
merged 4 commits into from
Jan 7, 2025

Conversation

taddes
Copy link
Contributor

@taddes taddes commented Dec 30, 2024

Description

We should document all of our pruning scripts.

This is running: https://github.com/mozilla-services/syncstorage-rs/blob/master/tools/spanner/purge_ttl.py - Deletes expired BSOs. Runs daily.

This is running: https://github.com/mozilla-services/syncstorage-rs/blob/master/tools/tokenserver/process_account_events.py - Updates tokenserver user records per FxA events (SQS queue). Runs constantly.

This is NOT running (as of 2024-03-12): https://github.com/mozilla-services/syncstorage-rs/blob/master/tools/tokenserver/purge_old_records.py - Deletes obsolete user records (old obsolete user records, and potentially all of a user’s records if they’ve deleted their account). Currently not running at all.

Testing

N/A

Issue(s)

Closes SYNC-4182.

@taddes taddes self-assigned this Dec 30, 2024
@jrconlin
Copy link
Member

jrconlin commented Jan 6, 2025

Looks like this needs cargo update, but otherwise 👍🏻

@taddes
Copy link
Contributor Author

taddes commented Jan 6, 2025

Thanks @jrconlin, will do to tie that in. I added links to the Kubernetes workloads so it’s not a mystery where these things are managed. I think having all that nailed down is gonna really help. I’ll also have it in Jira.

@taddes taddes requested review from jrconlin and pjenvey January 6, 2025 21:18
The script is intended for internal use within Mozilla's Firefox Accounts (FxA)-supported deployments and provides a mechanism for administrative tasks like disconnecting devices or marking accounts for cleanup.

Note that this is a purely optional administrative task, highly specific to
Mozilla's internal Firefox-Accounts-supported deployment.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

While optional, running this script is strongly encouraged, as no expired and inaccessible user data will be removed from storage.

@jrconlin jrconlin self-requested a review January 7, 2025 21:22
@jrconlin jrconlin merged commit 7c9bc00 into master Jan 7, 2025
9 checks passed
@jrconlin jrconlin deleted the docs/document-pruning-scripts-SYNC-4182 branch January 7, 2025 21:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants