Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Object store failing during bulk delete in S3 #6483

Open
Omega359 opened this issue Sep 30, 2024 · 3 comments
Open

Object store failing during bulk delete in S3 #6483

Omega359 opened this issue Sep 30, 2024 · 3 comments
Labels

Comments

@Omega359
Copy link
Contributor

Describe the bug

This started recently and I'm uncertain as to the cause. I have a rather large S3 directory (10TB) that I delete using the following code:

let object_store_s3_path = &object_store::path::Path::from(s3_path);
let stream = object_store.list(Some(object_store_s3_path)).map_ok(|m| m.location).boxed();
object_store.delete_stream(stream).try_collect::<Vec<Path>>().await?;

The error I started receiving this weekend is:

Got invalid DeleteObjects response: unknown variant `Code`, expected `Deleted` or `Error`

Caused by:
    0: Got invalid DeleteObjects response: unknown variant `Code`, expected `Deleted` or `Error`
    1: unknown variant `Code`, expected `Deleted` or `Error`

Using version 0.11.0.

Deleting the directory via other tooling works as expected.

To Reproduce

For me just attempting to delete a large directory seems to trigger it.

Expected behavior

Additional context

@Omega359 Omega359 added the bug label Sep 30, 2024
@ByteBaker ByteBaker removed their assignment Oct 1, 2024
@tustvold
Copy link
Contributor

tustvold commented Oct 1, 2024

I think we would need a reproducer in order to be able to action this

@Omega359
Copy link
Contributor Author

Omega359 commented Oct 1, 2024

It's on my todo list @tustvold - hopefully this week I'll have a standalone project that tickles this bug

@Omega359
Copy link
Contributor Author

I apologize for not getting to a reproducer for this ticket yet - I'm hoping to find time in the next couple of weeks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants