RubyGems Navigation menu

rawler 0.0.5

Rawler is a Ruby library that crawls your website and checks the status code for each of your links. Useful for finding dead links. Rawler will only parse pages with content type 'text/html', but it will check for the response code of every link. Please note: I had to temporarily remove url encoding in order to resolve some issues, so if you find any issue, please let me know. I'm also going to use Mechanizer for parsing pages with the next release.

Gemfile:
=

install:
=

Versions:

  1. 0.1.8 September 07, 2013 (21 KB)
  2. 0.1.7 December 02, 2012 (21 KB)
  3. 0.1.6 July 17, 2012 (20.5 KB)
  4. 0.1.5 April 14, 2012 (20 KB)
  5. 0.1.4 February 27, 2012 (20 KB)
  6. 0.0.5 January 20, 2011 (17.5 KB)
Show all versions (18 total)

Runtime Dependencies (1):

nokogiri >= 0

Development Dependencies (1):

hoe >= 2.8.0

Owners:

Authors:

  • Oscar Del Ben

SHA 256 checksum:

=

Total downloads 70,662

For this version 3,523

Version Released:

Licenses:

N/A

Required Ruby Version: None

Links: