Skip to content
This repository has been archived by the owner on May 15, 2024. It is now read-only.
This repository has been archived by the owner on May 15, 2024. It is now read-only.

Last pack job should get prepared after a certain duration #169

Closed
@xinaxu

Description

In the current implementation, only when the size of a pack job is more than a threshold (default 16GB), it will be prepared by the dataset worker.

This means if the pack job never reaches 16GB, it will never get prepared, which can happen if the client has less than 16GB data or their last chunk of data is less than 16GB and they are no longer pushing new blobs.

The fix is to pack remaining files after a certain duration (24h, hardcoded or configurable)

Metadata

Assignees

Labels

P0betaFeature for Beta release

Type

No type

Projects

  • Status

    Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions