S3 Export: EntityTooSmall Message: Your proposed upload is smaller than the minimum allowed object size

[kungasc]

I do export to S3 with zstd compression and get an error:

ydb export s3 --s3-endpoint https://storage.yandexcloud.net --compression zstd

error: Unable to parse ExceptionName: EntityTooSmall Message: Your proposed upload is smaller than the minimum allowed object size.

According to the S3 documentation:

Special errors
Error Code: EntityTooSmall

Description: Your proposed upload is smaller than the minimum allowed object size. Each part must be at least 5 MB in size, except the last part.

HTTP Status Code: 400 Bad Request

Here we check that we collect enough data for multipart content:

ydb/ydb/core/tx/datashard/export_s3_buffer.cpp

Line 327 in b392a83

if (Buffer.Size() < MinBytes) {

ydb/ydb/core/tx/datashard/export_s3.h

Line 49 in b392a83

.WithMinBytes(minBytes)

But the resulting compressed size may be less than given limit

It seems that the bug was introduced in #14862

[UgnineSirdis]

Revert this commit in 25-1-1: #17506

[UgnineSirdis]

Revert this commit in 25-1: #17524