You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Are there any available details regarding time restrictions, such as requests per hour or per day, and on which sites, in order to adjust sleep timers accordingly to those limitations?
Edit: Talking of the bot detection by ImmoScout24.
Best
The text was updated successfully, but these errors were encountered:
Hi @Scrapnon,
We don't have explicit support for that in Flathunter, but if you're
running the crawler out of cron or systemd, you can obviously configure the
frequency of the runs there. Doing that on a per-site basis would be more
complicated.
We have had other requests to limit the rate of crawling. It would
certainly be an interesting feature to have.
Scrapnon ***@***.***> schrieb am Do., 25. Jan. 2024, 15:50:
Hello,
Are there any available details regarding time restrictions, such as requests per hour or per day, and on which sites, in order to adjust sleep timers accordingly to those limitations?
Edit: Talking of the bot detection by ImmoScout24.
Best
The text was updated successfully, but these errors were encountered: