RubyGems Navigation menu

robotstxt 0.5.2

Robotstxt Parser allows you to the check the accessibility of URLs and get other data. Full support for the robots.txt RFC, wildcards and Sitemap: rules.

Gemfile:
=

instalar:
=

Versões:

  1. 0.5.4 February 13, 2010 (7,5 KB)
  2. 0.5.3 February 13, 2010 (7,5 KB)
  3. 0.5.2 December 19, 2009 (7,5 KB)
  4. 0.5.1 December 06, 2009 (5 KB)
  5. 0.5.0 December 06, 2009 (5 KB)

Development Dependencies (2):

echoe ~> 3.1
rake ~> 0.8

Donos:

Autores:

  • Simone Rinzivillo

SHA 256 checksum:

=

Total de downloads 30.564

Desta versão 3.456

Versão lançada:

Licenças:

N/A

Versão Requerida do Ruby: Nenhum

Versão Requerida do RubyGems: >= 1.2

Links: