-
Notifications
You must be signed in to change notification settings - Fork 594
Increase the memory allocated to 'BOT_TMPDIR' to 1GB #5078
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
|
/gcbrun |
8eaf0ac to
28e1d2a
Compare
The 90MB tmpfs mount allocated for 'BOT_TMPDIR' is insufficient for downloading large corpus backup files, leading to the "OSError: [Errno 28] No space left on device" error in Cuttlefish and Linux hosts. This change increases the tmpfs mount size to 1GB to accommodate larger corpus backup files.
|
/gcbrun |
marktefftech
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@javanlacerda From our analysis, the largest corpus size needed to download is approximately ~800MB, hence the selection of 1GB as the size.
Please let us know if this works for you.
I think it should be all good. Any inputs here @jonathanmetzman ? |
|
ACtually better than enlarging this, could we put the backup in the same volume as the testcases? |
jonathanmetzman
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Have you verified this works?
| # set up mounts in this case. | ||
| if [[ -z "$DISABLE_MOUNTS" ]]; then | ||
| # Setup Tmpfs dirs for frequently accessed files to save disk I/O. | ||
| mount -t tmpfs -o size=250M,mode=777 tmpfs $INSTALL_DIRECTORY/clusterfuzz/bot/inputs/fuzzer-testcases/ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's put it here and increase this size to 1.25GB
The 90MB tmpfs mount allocated for 'BOT_TMPDIR' ('/mnt/scratch0/tmp') is insufficient for downloading large corpus backups, leading to "OSError: [Errno 28] No space left on device" error in Cuttlefish and Linux hosts .
This error occurs during corpus synchronization, when a corpus backup zip file is downloaded to a temporary file within '/mnt/scratch0/tmp' in _sync_corpus_to_disk() before being extracted. If the said corpus' zip file exceeds 90MB, the download attempt fails.
This change increases the size of the 'BOT_TMPDIR' tmpfs mount to 1GB to accommodate for a large corpus backup zip file and prevent this error.