kabutops 0.0.7
Dead simple yet powerful Ruby crawler for easy parallel crawling with support for an anonymity.
Gemfile:
=
install:
=
Runtime Dependencies (9):
cachy
~> 0.4
elasticsearch
~> 1.0
hashie
~> 3.0
json
~> 1.8
mechanize
~> 2.7
moneta
~> 0.7
redis
~> 3.0
redis-namespace
~> 1.4
sidekiq
~> 3.1
Development Dependencies (2):
rspec
~> 3.0
rspec-mocks
~> 3.0