Skip to content

[Question]: The problem of slow index building #5514

Open
@3414391918

Description

@3414391918

Describe your problem

Image

As shown in the figure, what I understand is that a large amount of entity and relationship information needs to be inserted into es during the construction of the graph index. It takes about ten seconds between the two es requests. I think this is the reason why the index construction is slow. After I optimized the extraction and merging process of entities and relationships, it is quite fast and can be completed in less than ten minutes. But the process of this es operation lasted 3-4 hours. If there are thousands of entities and relationships in my document, and the time between 2 es requests is about a few seconds, that can also explain why this process lasts so long. If my understanding is correct, I would like to know how to optimize this problem. After all, this process takes too much time.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions