cobweb 1.0.24

Cobweb is a web crawler that can use resque to cluster crawls to quickly crawl extremely large sites which is much more performant than multi-threaded crawlers. It is also a standalone crawler that has a sophisticated statistics monitoring interface to monitor the progress of the crawls.

Gemfile:
= 复制到剪贴板已复制！

安装:
=

版本列表:

1.2.1 - January 09, 2021 (9.3 MB)
1.2.0 - February 25, 2019 (9.3 MB)
1.1.0 - November 06, 2015 (9.3 MB)
1.0.29 - November 05, 2015 (9.3 MB)
1.0.28 - March 20, 2015 (9.3 MB)
1.0.24 - January 22, 2015 (9.3 MB)

显示所有版本 (共 94 个)

Runtime 依赖 (9):

addressable >= 0

awesome_print >= 0

haml >= 0

json >= 0

nokogiri >= 0

redis >= 0

redis-namespace >= 0

sinatra >= 0

slop ~> 3.4

显示所有传递性依赖

业主:

作者:

Stewart McKee

SHA 256 校验和:

9297f2c5907e22f4862e98303768d0d423f45f5330ba664067219fc5aa33b986

cobweb 1.0.24

Gemfile:
= 复制到剪贴板已复制！

安装:
=

版本列表:

Runtime 依赖 (9):

业主:

作者:

SHA 256 校验和:

下载总量 323,952

这个版本 2,569

许可:
MIT

需要的 Ruby 版本: >= 0

链接:

cobweb 1.0.24

Gemfile: = 复制到剪贴板 已复制！

安装: =

版本列表:

Runtime 依赖 (9):

业主:

作者:

SHA 256 校验和:

下载总量 323,952

这个版本 2,569

许可: MIT

需要的 Ruby 版本: >= 0

链接:

Gemfile:
= 复制到剪贴板已复制！

安装:
=

许可:
MIT