Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use pre-allocated protobufs during backups. #5404

Merged
merged 10 commits into from
May 22, 2020
Merged

Use pre-allocated protobufs during backups. #5404

merged 10 commits into from
May 22, 2020

Commits on May 8, 2020

  1. Use a sync pool to store posting lists during backup. 

    Backups convert the values stored in disk into an intermediate format
(for backwards compatibility reasons). This creates a lot of
pb.PostingList and pb.BackupPostingList objects that are discarded
almost immediatly. Using a sync.Pool to allocate these objects should
reduce the amount of memory that is allocated during a backup.
    @martinmr
    martinmr committed May 8, 2020
    Configuration menu
    Copy the full SHA
    8f354d9 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2020

  1. Use a pre-allocated array instead of a sync.Pool.

    @martinmr
    martinmr committed May 12, 2020
    Configuration menu
    Copy the full SHA
    13d8645 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2020

  1. Merge remote-tracking branch 'origin/master' into martinmr/backup-pools

    @martinmr
    martinmr committed May 18, 2020
    Configuration menu
    Copy the full SHA
    b0bd39f View commit details
    Browse the repository at this point in the history

  2. Update badger version.

    @martinmr
    martinmr committed May 18, 2020
    Configuration menu
    Copy the full SHA
    322a13d View commit details
    Browse the repository at this point in the history

  3. Update logic to use thread id from the iterator.

    @martinmr
    martinmr committed May 18, 2020
    Configuration menu
    Copy the full SHA
    7e38b1e View commit details
    Browse the repository at this point in the history

  4. Update badger version.

    @martinmr
    martinmr committed May 18, 2020
    Configuration menu
    Copy the full SHA
    724dba8 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2020

  1. Fix deepsource warnings.

    @martinmr
    martinmr committed May 19, 2020
    Configuration menu
    Copy the full SHA
    a69d9be View commit details
    Browse the repository at this point in the history

Commits on May 22, 2020

  1. Merge remote-tracking branch 'origin/master' into martinmr/backup-pools

    @martinmr
    martinmr committed May 22, 2020
    Configuration menu
    Copy the full SHA
    a239843 View commit details
    Browse the repository at this point in the history

  2. Update badger.

    @martinmr
    martinmr committed May 22, 2020
    Configuration menu
    Copy the full SHA
    f770de6 View commit details
    Browse the repository at this point in the history

  3. Address review comments.

    @martinmr
    martinmr committed May 22, 2020
    Configuration menu
    Copy the full SHA
    e5ba765 View commit details
    Browse the repository at this point in the history