hiprice-runner

Crawler for HiPrice.

Run

hiprice-runner uses Chrome/Chromium(64+) for crawling. Make sure you have installed.
hiprice-runner uses Beanstalk as job queue, Make sure you have installed.
Check Beanstalk host/port and Chrome exec/args in conf.yaml.
Close all Chrome/Chromium instances.
Compile this repo with go build, execute the binary directly.

Name		Name	Last commit message	Last commit date
Latest commit History 28 Commits
rules		rules
vendor		vendor
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
conf.go		conf.go
conf.yaml		conf.yaml
crawl.go		crawl.go
ext_crawl_msg.go		ext_crawl_msg.go
go.mod		go.mod
go.sum		go.sum
main.go		main.go
rules.go		rules.go
runner_test.go		runner_test.go
struct.go		struct.go