Commits

History for

Commits on Jan 19, 2015

Test the parse command locally instead of against an external url
curita
committedJan 19, 2015

Commits on Dec 11, 2014

S3DownloadHandler: fix auth for requests with quoted paths/query params
immerrr
committedDec 11, 2014

Commits on Nov 28, 2014

scrapy#977 - test dropping requests
ldmberman
committedNov 28, 2014

Commits on Nov 27, 2014

An attempt to resolve scrapy#977 , add signal to be sent when request is dropped by the scheduler
ldmberman
committedNov 27, 2014

Commits on Nov 26, 2014

Merge pull request scrapy#954 from kalessin/int-download-timeout
pablohoffman
committedNov 26, 2014

Commits on Nov 25, 2014

Merge pull request scrapy#946 from tpeng/limit-response-size
pablohoffman
committedNov 25, 2014
attemp to fix travis fails
tpeng
committedNov 25, 2014

Commits on Nov 21, 2014

mitmproxy 0.10.1 needs netlib 0.10.1 too
dangra
committedNov 21, 2014
pin mitmproxy 0.10.1 as >0.11 does not work with tests
dangra
committedNov 21, 2014
Force to read DOWNLOAD_TIMEOUT as int (for example to pass using
kalessin
committedNov 21, 2014

Commits on Nov 19, 2014

add 2 more test cases and minor doc fixes
tpeng
committedNov 19, 2014

Commits on Nov 12, 2014

avoid download large response
tpeng
committedNov 12, 2014

Commits on Nov 4, 2014

Merge pull request scrapy#882 from ahlen/feature/csvfeed-quotechar
pablohoffman
committedNov 4, 2014

Commits on Sep 22, 2014

dont_obey_robotstxt meta key; don't process requests to /robots.txt
kmike
committedSep 22, 2014

Commits on Sep 20, 2014

TST small cleanup of a cookie test
kmike
committedSep 20, 2014
Merge pull request scrapy#878 from andrewshir/master
kmike
committedSep 20, 2014

Commits on Sep 14, 2014

Test for local domains (without dots) added
andrewshir
committedSep 14, 2014

Commits on Sep 13, 2014

added a test-case for wrong quotechar
ahlen
committedSep 13, 2014
Allow to specify the quotechar in CSVFeedSpider
ahlen
committedSep 13, 2014

Commits on Sep 11, 2014

SPIDER_MODULES can be set as a csv string
dangra
committedSep 11, 2014

Commits on Sep 10, 2014

Add the tests changes for previous commit
dangra
committedSep 10, 2014

Commits on Sep 9, 2014

Do not pop the crawler from the managed list
dangra
committedSep 9, 2014

Commits on Sep 2, 2014

Test verifying that CrawlerRunner populates spider class settings

curita
authored and
dangra
committedSep 2, 2014
Per-spider settings tests

curita
authored and
dangra
committedSep 2, 2014
Merge pull request scrapy#816 from Curita/api-cleanup
dangra
committedSep 2, 2014

Commits on Aug 28, 2014

SgmlLinkExtractor - fix for parsing <area> tag with Unicode present
yakxxx
committedAug 28, 2014

Commits on Aug 18, 2014

Merge pull request scrapy#846 from rocioar/master
dangra
committedAug 18, 2014

Commits on Aug 16, 2014

jsonrpc webservice moved to https://github.com/scrapy/scrapy-jsonrpc repository
dangra
committedAug 16, 2014

Commits on Aug 15, 2014

fix dont settings on meta behaviour, add docs and tests
rocioar
committedAug 15, 2014

Commits on Aug 14, 2014

Change error type when updating frozen settings
curita
committedAug 14, 2014
Deprecate Crawler.spiders attribute
curita
committedAug 14, 2014

Commits on Aug 12, 2014