Skip to content

cowboyrushforth/linkfinder

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LinkFinder v0.0.1
--------------------------------------------------------------

A zeromq service written in C that will crawl a url 
and return a list of linking urls in json format.

This is an experimental project mostly for
educational purposes.

Please let me know if you find any bugs.  

Cheers


Dependencies needed to compile:
-----------------------------------------------------------------
LibXML2 (tested 2.7.3)  [http://xmlsoft.org/]
ZeroMQ  (tested 2.1.4)  [http://www.zeromq.org/]
LibCURL (tested 7.19.7) [http://curl.haxx.se/]
Json-C  (tested 0.9)    [http://oss.metaparadigm.com/json-c/]

So far only tested on OSX 10.6.7, but should work on most posix
systems.


client.rb contains a ruby test client that takes a url as its
first argument.

About

a zeromq aka 0mq service for finding links on websites

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published