Find a mechanism to prevent bot detection by websites

[charlypa]

Once we hit any website continuously. The websites will throttle the crawler traffic. This is a mechanism by websites to prevent DOS attacks. Hence, find a way to prevent websites from throttling our requests.