Replays not visible due to Storage GET error: NoSuchKey #97984
Description
Environment
self-hosted (https://develop.sentry.dev/self-hosted/)
Steps to Reproduce
Steps to Reproduce
Deploy self-hosted Sentry 25.7.0 on Kubernetes.
Configure S3 storage backend (Wasabi).
Enable Replays and generate a replay from the frontend.
Attempt to open the replay in the UI.
Observe that the replay viewer is empty and logs contain NoSuchKey.
Expected Result
Replays will be displayed.
Actual Result
Replays are ingested but not visible in the Sentry UI.
When trying to open a replay, this error is displayed.
Logs show warnings from the web service:
k logs -l role=web -f
Traceback (most recent call last): File "/usr/src/sentry/src/sentry/snuba/referrer.py", line 1132, in validate_referrer raise Exception(error_message) Exception: referrer replays.query.browse_scalar_conditions_subquery is not part of Referrer Enum 08:36:40 [WARNING] sentry.snuba.referrer: referrer replays.query.browse_scalar_conditions_subquery is not part of Referrer Enum 08:36:40 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_recent_searches.OrganizationRecentSearchesEndpoint' response=200 user_id='70' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/D..../recent-searches/' caller_ip='195.250.86.154' user_agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/139.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.05380606651306152 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None') Traceback (most recent call last): File "/usr/src/sentry/src/sentry/snuba/referrer.py", line 1132, in validate_referrer raise Exception(error_message) Exception: referrer replays.query.browse_query is not part of Referrer Enum 08:36:40 [WARNING] sentry.snuba.referrer: referrer replays.query.browse_query is not part of Referrer Enum 08:36:40 [INFO] sentry.access.api: api.access (method='GET' view='sentry.replays.endpoints.organization_replay_index.OrganizationReplayIndexEndpoint' response=200 user_id='70' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/D..../replays/' caller_ip='195.250.86.154' user_agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/139.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.20275449752807617 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None') Traceback (most recent call last): File "/usr/src/sentry/src/sentry/snuba/referrer.py", line 1132, in validate_referrer raise Exception(error_message) Exception: referrer replays.query.details_query is not part of Referrer Enum 08:36:46 [WARNING] sentry.snuba.referrer: referrer replays.query.details_query is not part of Referrer Enum 08:36:46 [INFO] sentry.access.api: api.access (method='GET' view='sentry.replays.endpoints.organization_replay_details.OrganizationReplayDetailsEndpoint' response=200 user_id='70' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/D..../replays/ea7ffbe2d13d40b482a647e67d3df996/' caller_ip='195.250.86.154' user_agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/139.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.18056273460388184 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None') Traceback (most recent call last): File "/usr/src/sentry/src/sentry/snuba/referrer.py", line 1132, in validate_referrer raise Exception(error_message) Exception: referrer replays.endpoints.viewed_by_post is not part of Referrer Enum 08:36:46 [WARNING] sentry.snuba.referrer: referrer replays.endpoints.viewed_by_post is not part of Referrer Enum 08:36:46 [INFO] sentry.access.api: api.access (method='GET' view='sentry.replays.endpoints.organization_replay_events_meta.OrganizationReplayEventsMetaEndpoint' response=200 user_id='70' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/D..../replays-events-meta/' caller_ip='195.250.86.154' user_agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/139.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.10608363151550293 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None') 08:36:46 [INFO] sentry.access.api: api.access (method='GET' view='sentry.replays.endpoints.organization_replay_events_meta.OrganizationReplayEventsMetaEndpoint' response=200 user_id='70' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/D..../replays-events-meta/' caller_ip='195.250.86.154' user_agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/139.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.1275625228881836 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None') 08:36:46 [INFO] sentry.access.api: api.access (method='GET' view='sentry.replays.endpoints.project_replay_recording_segment_index.ProjectReplayRecordingSegmentIndexEndpoint' response=200 user_id='70' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/projects/D..../galaxsys-keno-client/replays/ea7ffbe2d13d40b482a647e67d3df996/recording-segments/' caller_ip='195.250.86.154' user_agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/139.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.15434837341308594 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None') 08:36:46 [INFO] sentry.access.api: api.access (method='POST' view='sentry.replays.endpoints.project_replay_viewed_by.ProjectReplayViewedByEndpoint' response=204 user_id='70' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/projects/D..../galaxsys-keno-client/replays/ea7ffbe2d13d40b482a647e67d3df996/viewed-by/' caller_ip='195.250.86.154' user_agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/139.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.1698145866394043 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None') 08:36:47 [WARNING] root: Storage GET error: NoSuchKey('An error occurred (NoSuchKey) when calling the GetObject operation: The specified key does not exist.') 08:36:47 [WARNING] root: Storage GET error: NoSuchKey('An error occurred (NoSuchKey) when calling the GetObject operation: The specified key does not exist.') 08:36:47 [WARNING] root: Storage GET error: NoSuchKey('An error occurred (NoSuchKey) when calling the GetObject operation: The specified key does not exist.')
Product Area
Replays
Link
No response
DSN
No response
Version
25.7.0