Skip to content

Releases: pmyteh/RISJbot

New scrapers and readability fallback extractor

08 Aug 16:45
Compare
Choose a tag to compare

The highlights of this release are the addition of a number of new news source scrapers, and particularly the addition of a fallback headline and text extractor based on the readability language. This means that, even if the site being scraped serves up an unknown page format, we can attempt to extract the body text and headline using heuristics.

A number of bug fixes are also included.

First release, for content pilot project

07 Feb 17:23
Compare
Choose a tag to compare
v1.0.0

First release, for data collection pilot