Output fails with 413 Payload Too Large

[msvticket]

Output is failing occasionally since ElasticSearch is giving a http status 413 response with the message {"Message":"Request size exceeded 10485760 bytes"}

The actual error in the log is

[logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backof

The ElasticSearch is an AWS Elasticsearch service. AWS is apparently restricting the setting of http.max_content_length 10MB for smaller instance types according to this table:
https://docs.aws.amazon.com/elasticsearch-service/latest/developerguide/aes-limits.html#network-limits

[Oktaz]

Hitting this issue as well. I think by making the following variable configurable could resolve the issue.

logstash-output-elasticsearch/lib/logstash/outputs/elasticsearch/http_client.rb

Line 24 in 443b07b

TARGET_BULK_BYTES = 20 * 1024 * 1024 # 20MiB

[RishikeshDarandale]

Any update on these changes?

[lifeofguenter]

Same issue with https://github.com/awslabs/logstash-output-amazon_es - ideally this should be configurable.