Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prediction of remaining time after restart #118

Open
pbinkley opened this issue Mar 7, 2022 · 0 comments
Open

Prediction of remaining time after restart #118

pbinkley opened this issue Mar 7, 2022 · 0 comments

Comments

@pbinkley
Copy link

pbinkley commented Mar 7, 2022

After restarting a crawl, the prediction of remaining time is extremely short. I've just restarted a SUCHO crawl (using the Docker image provided) at 4294/9576, and after 11 minutes it predicts 13.7 minutes remaining. The prediction was something like 4 hours before hte restart. I think it is doing something like assuming the 4294 were handled during the new run, at a rate of about 390/minute, and using that for the prediction (though the numbers don't work out exactly). Desired behavior: base the prediction of remaining time on the total running time of the original run and the restarted run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant