Skip to content
This repository has been archived by the owner on Apr 26, 2024. It is now read-only.
This repository has been archived by the owner on Apr 26, 2024. It is now read-only.

Do federation catchup in "buckets" #9632

Closed
@ShadowJonathan

Description

When trying out v1.30.0rc1 when fixing my federation stall (which was fixed by #9561), I set the stream_id to 0, which means the federation senders are now trying to send all events since the beginning of my homeserver history.

To me, this is not a huge deal, federation will restore eventually (eventual consistency), but I noticed that each caught-up event is being sent individually, while with the batching nature of matrix, you could send up to 100 (sanity-limited to 50) events at a time to a server.

Would it be possible to allow for the federation sender to take "chunks" of events (about a 100) which turn out to be send-able, and send these in batches at a time? This could increase catch-up speeds, and allow higher throughput even when the federation sender "stumbles" and gets into catch-up mode.

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions