Skip to content

Set a bounded default for http.max_warning_header_count #33479

Closed
@tomcallahan

Description

Today we do not by default limit the number of HTTP Warning headers emitted when users of Elasticsearch trigger deprecated functionality. As of 6.4.0 we will emit a warning for each docvalue_fields item without a format parameter in an msearch query, which is currently leveraged
by Kibana when using the Discover feature for instance.

Here is an example message, of which there can be many:
#! Deprecation: Doc-value field [date2] is not using a format. The output will change in 7.0 when doc value fields get formatted based on mappings by default. It is recommended to pass [format=use_field_mapping] with the doc value field in order to opt in for the future behaviour and ease the migration to 7.0.

In the context of accessing Elasticsearch through a proxy this can be problematic, as a large number of header records can cause proxies to fail.
This can be difficult behavior to debug/diagnose, as proxies convey errors such as Bad Gateway. I'd like to discuss setting a bounded default (at a minimum by header count, but perhaps also by header bytes).

The Kibana side of this issue is located in elastic/kibana#22484.

Further reading on user impact: https://discuss.elastic.co/t/bad-gateway-errors-in-discover-in-kibana-6-4-on-some-indices/146576

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions