New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reduce data loss on deploy #73

Open

devinmatte opened this issue Feb 9, 2024 · 0 comments

Member

devinmatte commented Feb 9, 2024 •

edited

Loading

When we push a new deploy, a few things happen or can happen:

Service restarts, missing a few data points

In a rare case, the EC2 instance needs to be recreated. In this case we're going to miss a lot of data points. Things we can do to reduce that:

Force data to be pushed to s3 during a deploy so we lose the minimal amount
When new EC2 is started up, pull down all of todays data from s3 so the service doesn't overwrite all earlier data on first upload
Only apply these updates at 3am 🙃

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment