-
Notifications
You must be signed in to change notification settings - Fork 223
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Race conditon when building with parallel make #200
Comments
Another instance of a different faliure but still due to parallel make:
|
Looking at the makelog, it looks make is somehow thinking that the util/symlinks has gotten out of date, and multiple instances of make is trying to rebuild it, and they are stepping on each other. . It's not something I can replicate on my set up, and it's certainly not anything that is showing up on the Debian autobuilders. What kind of file system is /buildstream-build? Would it happen to be nfs, or some kind of file system with one second granularity timestamps? |
It's FUSE bases, more specifically uses buildbox-fuse https://gitlab.com/BuildGrid/buildbox/buildbox/-/tree/master/fuse?ref_type=heads |
Can you replicate the problem without using the FUSE bases? I have a feeling that it may be screwing up by incorrectly caching file timestamps, or something thing else which makes it a bug in your storage stack. As I said, it's not something I can replicate, nor has anyone else reported it to me using a standard Linux file system. |
Buildstream is the primary development/build environment we use, testing outside that is probably not ideal. Somehow I don't think it's an issue with the filesystem, considering we managed to switch several (20+) modules to parallel make https://gitlab.com/freedesktop-sdk/freedesktop-sdk/-/merge_requests/21041 and e2fsprogs was the only one showing various race conditions in CI. The build even passed with parallel make once (although we had to revert it the next day since the race condition happened again). I can ask someone more familiar with buildbox-fuse to follow up here if you suspect it's an issue with |
This started happening after moving to parallel make from
-j1
. The relevant portion seems to be:Although it errors at various other places as well.
Full log: 3537ff57-build.20241022-000542.txt
The text was updated successfully, but these errors were encountered: