When you use invisibility potion the mod throws an error and all waypoints disappear.
My guess is that currently it gets your position from the online map itself and that's why everything breaks when you disappear from the online map.
I propose to instead get your own coordinates from the client, so that doesn't happen