Skip to content

Commit b963d42

Browse files
committed
Remove S3 output stream (#27280)
Now the blob size information is available before writing anything, the repository implementation can know upfront what will be the more suitable API to upload the blob to S3. This commit removes the DefaultS3OutputStream and S3OutputStream classes and moves the implementation of the upload logic directly in the S3BlobContainer. related #26993 closes #26969
1 parent 5a5c581 commit b963d42

File tree

9 files changed

+562
-604
lines changed

9 files changed

+562
-604
lines changed

docs/plugins/repository-s3.asciidoc

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -206,9 +206,10 @@ The following settings are supported:
206206
http://docs.aws.amazon.com/AmazonS3/latest/dev/uploadobjusingmpu.html[AWS Multipart Upload API]
207207
to split the chunk into several parts, each of `buffer_size` length, and
208208
to upload each part in its own request. Note that setting a buffer
209-
size lower than `5mb` is not allowed since it will prevents the use of the
210-
Multipart API and may result in upload errors. Defaults to the minimum
211-
between `100mb` and `5%` of the heap size.
209+
size lower than `5mb` is not allowed since it will prevent the use of the
210+
Multipart API and may result in upload errors. It is also not possible to
211+
set a buffer size greater than `5gb` as it is the maximum upload size
212+
allowed by S3. Defaults to the minimum between `100mb` and `5%` of the heap size.
212213

213214
`max_retries`::
214215

plugins/repository-s3/src/main/java/org/elasticsearch/repositories/s3/DefaultS3OutputStream.java

Lines changed: 0 additions & 216 deletions
This file was deleted.

0 commit comments

Comments
 (0)