Skip to content

Commit 15cd332

Browse files
committed
Remove S3 output stream (#27280)
Now the blob size information is available before writing anything, the repository implementation can know upfront what will be the more suitable API to upload the blob to S3. This commit removes the DefaultS3OutputStream and S3OutputStream classes and moves the implementation of the upload logic directly in the S3BlobContainer. related #26993 closes #26969
1 parent 0a6ef65 commit 15cd332

File tree

9 files changed

+566
-615
lines changed

9 files changed

+566
-615
lines changed

docs/plugins/repository-s3.asciidoc

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -175,9 +175,10 @@ The following settings are supported:
175175
http://docs.aws.amazon.com/AmazonS3/latest/dev/uploadobjusingmpu.html[AWS Multipart Upload API]
176176
to split the chunk into several parts, each of `buffer_size` length, and
177177
to upload each part in its own request. Note that setting a buffer
178-
size lower than `5mb` is not allowed since it will prevents the use of the
179-
Multipart API and may result in upload errors. Defaults to the minimum
180-
between `100mb` and `5%` of the heap size.
178+
size lower than `5mb` is not allowed since it will prevent the use of the
179+
Multipart API and may result in upload errors. It is also not possible to
180+
set a buffer size greater than `5gb` as it is the maximum upload size
181+
allowed by S3. Defaults to the minimum between `100mb` and `5%` of the heap size.
181182

182183
`canned_acl`::
183184

plugins/repository-s3/src/main/java/org/elasticsearch/repositories/s3/DefaultS3OutputStream.java

Lines changed: 0 additions & 223 deletions
This file was deleted.

0 commit comments

Comments
 (0)