lame-sitemapper 0.1.0
It starts from the arbitrary page you provide and descents into the tree of links until it has either traversed all possible content on the web site or has stopped at some predefined traversal depth. It is written in Ruby and implemented as a CLI application. Based on user preference, it can output text reports in a standard sitemap.xml form (used by many search engines), a dot file (for easier site hierarchy visualization, graphviz compatible), a plain text file (displaying detailed hierarchical relations between pages) and a simple HTML format.
Gemfile:
=
install:
=
Versions:
- 0.1.0 August 26, 2020 (13.5 KB)
Runtime Dependencies (8):
activesupport
~> 6.0, >= 6.0.3.2
addressable
~> 2.3, >= 2.3.6
digest-murmurhash
>= 0.3.0, ~> 0.3
graphviz
>= 0.4.0, ~> 0.4
nokogiri
~> 1.6, >= 1.6.1
public_suffix
~> 1.4, >= 1.4.2
typhoeus
~> 0.6, >= 0.6.8
webrobots
~> 0.1, >= 0.1.1
Development Dependencies (3):
Owners:
Pushed by:
Authors:
-
Orest Kulik
SHA 256 checksum:
=