Skip to content

(Re)Starting a Data Node Holding a Large Number of Indices can Take Minutes #83203

Open
@original-brownbear

Description

@original-brownbear

Restarting a data node holding lots of indices takes an unexpected amount of time.
For a node holding ~10k Beats mapping indices, it takes ~10 minutes to re-start the node.

Effectively all the time is spent on validating mappings on a single hot thread:

image

We should find a way to speed this up, adding a 10 minute window to restarting a large data node makes operations complicated.

Metadata

Metadata

Assignees

No one assigned

    Labels

    :Distributed Coordination/Cluster CoordinationCluster formation and cluster state publication, including cluster membership and fault detection.>bugTeam:Distributed (Obsolete)Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions