Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] [OPENSEARCH] [AWS] - Error while deleting snapshot on S3 #14523

Open
cuasso opened this issue Jun 24, 2024 · 2 comments
Open

[BUG] [OPENSEARCH] [AWS] - Error while deleting snapshot on S3 #14523

cuasso opened this issue Jun 24, 2024 · 2 comments
Labels
bug Something isn't working Storage:Snapshots

Comments

@cuasso
Copy link

cuasso commented Jun 24, 2024

Describe the bug

We are saving a custom snapshot to S3 on AWS. For this purpose, we set up a custom s3 repository and create a policy that takes a daily snapshot and saves it to s3.
We don't have any problem with the save process, but the delete process always throws an error. It's a strange error because we see that the previous snapshot was being deleted, but the process fail.
The error is:

{
    "message": "[2024-06-22T23:01:04Z]: Caught exception while deleting snapshot [daily-snapshots-2024-06-15t23:00:42-vouq72uv].",
    "cause": "[2024-06-22T23:01:04Z]: groupSize must be greater than 0 but was -15"
}

We communicate with our aws support and they said that there isn't a problem with s3 configuration.

Related component

Storage:Snapshots

To Reproduce

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior

We hope that the snapshots will be deleted and the process will be marked as successful.

Additional Details

  • Open Search Version 2.11

S3 repository

image

Open Search Snapshot policy

image

Creation/Deletion Status

image
@cuasso cuasso added bug Something isn't working untriaged labels Jun 24, 2024
@andrross
Copy link
Member

I believe that error message is coming from here, which suggests there is a bug here. Even if the cause is some sort of misconfiguration, the error should be something more meaningful. @cuasso Can you get us the full stack trace from the logs to help pin this down?

@gbbafna
Copy link
Collaborator

gbbafna commented Jun 27, 2024

[Storage Triage - attendees 1 2 3 4 5 6 7 8 9 10 ]

@cuasso : As @andrross also said , stack trace would be helpful to proceed .

@gbbafna gbbafna removed the untriaged label Jun 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Storage:Snapshots
Projects
Status: 🆕 New
Development

No branches or pull requests

3 participants