I only just noticed that there are actually these really useful buttons that allow you to do things like load adjacent nodes:

I think I didn't notice them before because they just seemed like some 'info text'. Maybe a better way of bringing attention to this useful functionality is to change these to buttons