cobweb 0.0.18

Web Crawler that uses resque background job engine to allow you to cluster your crawl.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

1.2.1 - January 09, 2021 (9.28 MB)
1.2.0 - February 25, 2019 (9.28 MB)
1.1.0 - November 06, 2015 (9.28 MB)
1.0.29 - November 05, 2015 (9.28 MB)
1.0.28 - March 20, 2015 (9.28 MB)
0.0.18 - March 04, 2012 (15 KB)

Show all versions (94 total)

Runtime Dependencies (9):

absolutize >= 0

addressable >= 0

awesome_print >= 0

nokogiri >= 0

redis >= 0

resque >= 0

rspec >= 0

sinatra >= 0

thin >= 0

Show all transitive dependencies

Owners:

Authors:

Stewart McKee

SHA 256 checksum:

dd4709297096ce5dee67190c677259e84103f7e6b040b84673a07925feaff7f4