robot_rules 0.9.3

A tool to determine if the robots.txt would prevent a given user agent from making a request to a given URI.

Gemfile:
=

instalar:
=

Versiones:

0.9.3 July 21, 2010 (7 KB)
0.9.2 July 21, 2010 (7 KB)
0.9.1 July 09, 2010 (7 KB)

dependencias de Runtime (1):

addressable >= 2.1.2

Mostrar toda la cadena de dependencias

Propietarios:

Autores:

James Edward Gray II, Jeremy Friesen, Edgar Gonzalez

SHA 256 checksum:

=