tag:github.com,2008:https://github.com/peterbencze/serritor/releases 2020-06-11T12:37:00Z tag:github.com,2008:Repository/66035047/v2.1.1 2020-06-11T12:42:21Z <ul> <li>Fix bug where crawl seeds were fed to the frontier twice, resulting in incorrect crawl stats</li> <li>Fix bug where crawl stats were not reset when the crawler was restarted after its state was restored</li> <li>Update dependency versions</li> </ul> peterbencze tag:github.com,2008:Repository/66035047/v2.1.0 2019-06-18T22:18:59Z <p>This release includes new features, improvements and changes to the existing API.</p> <p>Changes in a nutshell:</p> <ul> <li>Add helper class for finding text in response content</li> <li>Refactor UrlFinder</li> <li>Modify HTTP client so that it uses the same user-defined HTTP proxy as Selenium</li> <li>Ignore authentication cookie when cookie authentication is not enabled</li> <li>Use MutableCapabilities instead of DesiredCapabilities when configuring the browser</li> </ul> peterbencze tag:github.com,2008:Repository/66035047/v2.0.0 2019-05-30T20:29:05Z <p>This major release includes a number of new features, bug fixes and changes to the existing API.<br> Changes in a nutshell:</p> <ul> <li>Add internal proxy server to overcome Selenium limitations (no access to response headers etc.)</li> <li>Add onBrowserInit callback to configure the browser before the crawling begins</li> <li>Always call onStop even if an unhandled exception is thrown</li> <li>Rename callbacks</li> <li>Add detailed logging</li> <li>Use slf4j instead of builtin logger</li> <li>Add web API feature<br> ... and more</li> </ul> peterbencze tag:github.com,2008:Repository/66035047/v1.6.0 2018-11-04T19:48:14Z <p>This release adds the possibility to specify custom callbacks for crawl events.</p> peterbencze tag:github.com,2008:Repository/66035047/v1.5.0 2018-09-02T21:52:02Z <p>This release includes bug fixes and a number of enhancements and new features.<br> Major changes in a nutshell:</p> <ul> <li>Change the access modifier of the stop method</li> <li>Add the possibility to download files</li> <li>Add the possibility to retrieve response content type</li> <li>Fix browser compatibility check exception when using HtmlUnitDriver</li> <li>Add default URL finder creation method</li> <li>Remove Selenium cookie synchronization</li> <li>Add support for loading config from previously saved state</li> <li>Add static methods for creating crawl requests with the default config</li> </ul> peterbencze tag:github.com,2008:Repository/66035047/v1.4.0 2018-06-23T14:13:33Z <p>This release includes a number of bug fixes and improvements.</p> peterbencze tag:github.com,2008:Repository/66035047/v1.3.1 2018-04-22T15:51:15Z <p>This release includes a new feature and changes to the existing API.<br> Changes in a nutshell:</p> <ul> <li>Changes how the crawler is configured: <ul> <li>Adds CrawlerConfigurationBuilder for building CrawlerConfiguration instances</li> <li>The configuration is passed to the crawler's constructor</li> </ul> </li> <li>Adds the possibility to download the file in onNonHtmlResponse callback</li> </ul> <p>Please check the Wiki for more information.</p> peterbencze tag:github.com,2008:Repository/66035047/v1.3.0 2018-03-16T23:35:31Z <p>This release includes new features, improvements and changes to the existing API.</p> <p>New features in a nutshell:</p> <ul> <li>Crawl domains: they specify the domains in which crawling is allowed</li> <li>Crawl delay mechanisms: these can be used to determine the delay between each request</li> <li>Url finder: it can be used to find URLs in HTML sources using regular expressions</li> </ul> <p>Please check the Wiki for more information.</p> peterbencze tag:github.com,2008:Repository/66035047/v1.2.1 2018-02-10T20:26:56Z <p>This release includes minor fixes and improvements (including changes to the API, please check the Wiki for more information).</p> peterbencze tag:github.com,2008:Repository/66035047/v1.2 2017-07-18T21:29:11Z <p>This release includes new features, bug fixes and major API modifications. Please check the documentation for more information.</p> peterbencze