-
Notifications
You must be signed in to change notification settings - Fork 1.1k
fix: log warning on sharing useState(), add id option to BasicCrawler
#3309
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Looking at the current changes, this is actually not breaking and we could merge it to Thoughts @janbuchar @B4nan ? The |
I slightly prefer going for |
|
I guess we should handle the crawler statistics this way too, and I would rather keep that for v4. And saying that, I would actually prefer some generic name not bound to the |
|
The last commits are passing the crawler id to the Regarding the identifier naming, I really don't have many ideas. How about |
|
|
|
I believe there are valid reasons to share the But this is a good point nonetheless - we should consider the implications of this in the |
Adds unique crawler id to the
BasicCrawlerclass. Prints a warning on multiple crawlers sharing the state onuseState().There might be more resources shared between different
BasicCrawler(-subclass) instances - this needs further investigation.Closes #3024