feat: add crawl delay option (closes #534)#805

gratach wants to merge 2 commits into

JustinBeckwith:mainJustinBeckwith/linkinator:mainfrom

gratach:add-crawl-delaygratach/linkinator:add-crawl-delayCopy head branch name to clipboard