robotstxt 0.5.2

Robotstxt Parser allows you to the check the accessibility of URLs and get other data. Full support for the robots.txt RFC, wildcards and Sitemap: rules.

Gemfile:
=

installation:
=

Versions:

0.5.4 February 13, 2010 (7,5 ko)
0.5.3 February 13, 2010 (7,5 ko)
0.5.2 December 19, 2009 (7,5 ko)
0.5.1 December 06, 2009 (5 ko)
0.5.0 December 06, 2009 (5 ko)

Dépendances de Development (2):

echoe ~> 3.1

rake ~> 0.8

Show all transitive dependencies

Propriétaires:

Auteurs:

Simone Rinzivillo

Total de contrôle SHA 256:

=

Total de téléchargements 30 564

Pour cette version 3 456

Version publiée:
December 19, 2009 3:00pm

License:
aucune

Version de Ruby requise: None

Required Rubygems Version: >= 1.2

Liens:

Page d'accueil Code Source Télécharger Review changes Badge RSS Signaler un abus Reverse dependencies