Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug-1908543: drop support for AWS #6669

Merged
merged 2 commits into from
Jul 23, 2024
Merged

bug-1908543: drop support for AWS #6669

merged 2 commits into from
Jul 23, 2024

Conversation

relud
Copy link
Member

@relud relud commented Jul 17, 2024

blocked by #6671 and #6672

@relud relud force-pushed the relud-bug-1908543-drop-aws branch 2 times, most recently from b4a1134 to 65b13e9 Compare July 17, 2024 23:28
@relud relud force-pushed the relud-bug-1908543-drop-aws branch 8 times, most recently from a6159f3 to fccda40 Compare July 19, 2024 23:48
@relud relud marked this pull request as ready for review July 19, 2024 23:50
@relud relud requested a review from a team as a code owner July 19, 2024 23:50
@relud relud requested a review from willkg July 19, 2024 23:50
@relud relud force-pushed the relud-bug-1908543-drop-aws branch from fccda40 to fca266e Compare July 22, 2024 16:07
@relud relud force-pushed the relud-bug-1908543-drop-aws branch from fca266e to 1e71a03 Compare July 22, 2024 16:16
Copy link
Contributor

@willkg willkg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! So long AWS!

We still need to do a pass on docs, but that's more involved and we can do that in a future PR.

Makefile Outdated Show resolved Hide resolved
Makefile Outdated Show resolved Hide resolved
bin/load_processed_crashes_into_es.py Show resolved Hide resolved
@@ -1,7 +1,5 @@
attrs==23.2.0
awscli==1.32.95
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🎉

@@ -30,7 +30,6 @@
import psutil
import sentry_sdk
from sentry_sdk.integrations.atexit import AtexitIntegration
from sentry_sdk.integrations.boto3 import Boto3Integration
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I checked this time. There are no general gcp integrations. There's one for google cloud functions and one for grpcio, but nothing for google-cloud-pubsub/storage.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I completely missed what you said about this in the equivalent Antenna PR. We came to the same conclusion, so that's cool. Sorry about that!

@@ -238,7 +238,7 @@ def test_crash_size_capture(self):
processed_crash=processed_crash,
)

mm.assert_histogram("processor.es.crash_document_size", value=169)
mm.assert_histogram("socorro.processor.es.crash_document_size", value=169)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For my notes: What's going on here is that this ran in the AWS context, but not the GCP context before. We set up the metrics interface in AWS without the "socorro" because that was set in configuration as a prefix in telegraf. In GCP, we set that as a prefix in the metrics interface. Or something like that. It's covered in bug 1898345.

Ergo, all the key names changed in the tests because we're now testing everything in the GCP context. So this is expected.

Comment on lines +480 to +484
records = metricsmock.filter_records(
"incr", stat="socorro.processor.sentry_scrub_error", value=1
)
assert len(records) == 1
assert {"service:cachemanager"}.issubset(records[0].tags)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Markus 5.0 has an AnyTagValue that will make this easier. The issue here is that there's a host tag and it changes run-to-run. (If I understand this correctly.)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

correct

@@ -68,9 +67,6 @@ def dockerflow_version(requst):

"""
version_info = get_version_info(settings.SOCORRO_ROOT)
# FIXME(willkg): Remove "cloud" after we finish the GCP migration. We use the
# environment variable here because settings doesn't have this variable.
version_info["cloud"] = os.environ.get("CLOUD_PROVIDER", "AWS")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💯

@willkg
Copy link
Contributor

willkg commented Jul 22, 2024

Also, removing awscli unblocks updating Sphinx. We can do that in a future PR, too.

Makefile Outdated Show resolved Hide resolved
Makefile Outdated Show resolved Hide resolved
@relud relud merged commit 5bde52a into main Jul 23, 2024
1 check passed
@relud relud deleted the relud-bug-1908543-drop-aws branch July 23, 2024 16:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants