-
-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ipfs add FAILS with "too many open files" #4589
Comments
@gwpl what is the output of |
$ ulimit -n Therefore, it may be nice for go-ipfs to implement gracefull degradation mechanism and adopt on the go to failures and work with as much handlers as it has, instead of crashing when new ones can not be obtained (or alternatively, to make option so I could limit to order of magnitude less file descriptors, e.g. 128). |
Most of the Can you try to monitor the daemon with the following command(may require you to install jq): export DPID=$(pidof ipfs); watch -n0 'printf "sockets: %s\nleveldb: %s\nflatfs: %s\n" $(ls /proc/${DPID}/fd/ -l | grep "socket:" | wc -l) $(ls /proc/${DPID}/fd/ -l | grep "\\/datastore\\/" | wc -l) $(ls /proc/${DPID}/fd/ -l | grep "\\/blocks\\/" | wc -l); netstat -anpt 2>/dev/null | grep "$DPID/ipfs" | sort -k6 | column -N "a,b,c,d,e,f,g" -J | jq ".table[].f" --raw-output | uniq -c' And report what are you seeing when adding the data? |
Please note that this is not during crash as:
Anyhow, I see in ipfs daemon output a lot of warnings like:
Please note that both |
@gwpl can you also try increasing the ulimit to something really high ( |
Using the experimental badger datastore should help significantly but, in general, IPFS is not going to work well over SSHFS. IPFS expects the datastore to be on the local machine. The issue here is likely that go-ipfs is opening files faster than it can write to them because SSHFS is so slow. Note: We should have some form of open fd tracking/limit in the flatfs (current default) datastore. However, we're planning on deprecating it for badgerdb once we deem it stable anyways so I kind of doubt that'll get done before then. |
Hi! I was not aware of badger datastore. If work on specialised store is in progress, let's wait for it! :) |
Version information:
Type:
Severity:
High
Description:
The text was updated successfully, but these errors were encountered: