Warn users when pinned dataset is larger than local GCThreshold #8413
Labels
kind/enhancement
A net-new feature or improvement to an existing feature
need/triage
Needs initial labeling and prioritization
Checklist
Description
In #8103 we saw users attempting to pin "large" data sets (in this case, 90GiB) reach a hangup during the pinning process.
If the size of the dataset you're attempting to pin is larger then GCThreshold, the chunks will be immediately garbage collected when ctl+c'ing or terminating the pin. This defeats the purpose of IPFS as users should be able to "resume" downloading chunks from where they left off if pinning is interrupted.
Instead of letting users pin potentially massive amounts of data which will unknowingly be destroyed, maybe a warning when this condition exists in
ipfs pin
would be beneficial?It would be better to guide users to increase their GCThreshold instead of silently letting them believe that IPFS can't resume pinning.
#8412 is another alternative strategy to fix this (Chunk garbage collection minimum time)
#3121 seems to be another alternative strategy for this (best effort pins)
The text was updated successfully, but these errors were encountered: