Skip to content

Indexing throughput drop after types removal issues deprecation messages #37411

Closed
@dliappis

Description

@dliappis

#36549 introduced deprecation messages when types are used in _bulk APIs.

This has caused major throughput drops in our standard nightly benchmarks (that use a _doc type) like the one seen here https://elasticsearch-benchmarks.elastic.co/#tracks/geopoint/nightly/30d:

image

Other tracks affected are http_logs, nyc_taxis, noaa, [geonames][(https://elasticsearch-benchmarks.elastic.co/#tracks/geonames/nightly/30d) and nested.

The deprecation logger is suppressing duplicate messages hence there is only one entry in the log file:

$ cat rally-benchmark_deprecation.log
[2019-01-14T11:05:37,399][WARN ][o.e.d.a.b.BulkRequest    ] [rally-node-0] [types removal] Specifying types in bulk requests is deprecated.

IMO a deprecated feature shouldn't cause a performance regression (at least not that magnitude) until it gets removed.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions