shelob 0.1.0
A giant spider that starts on a given page, finds all links on the page, ensure they resolve, and recurses if the link is underneath the starting url
Gemfile:
=
install:
=
Versions:
- 0.1.0 January 02, 2014 (11 KB)
- 0.1.0.beta4 December 31, 2013 (10.5 KB)
- 0.1.0.beta3 December 30, 2013 (10 KB)
- 0.1.0.beta2 December 30, 2013 (9 KB)
- 0.1.0.beta1 December 30, 2013 (9 KB)
Runtime Dependencies (1):
nokogiri
~> 1.6