RubyGems Navigation menu

tokenizers 0.1.1

Fast state-of-the-art tokenizers for Ruby

Versions:

  1. 0.1.1 - June 29, 2022 (24 KB)
  2. 0.1.0 - March 19, 2022 (24 KB)

Owners:

Pushed by:

Authors:

  • Andrew Kane

SHA 256 checksum:

720f67e9600160d368d12ce30352201cc7f2e22cc80f56f11bcda0d4cea00bc7

Total downloads 745

For this version 237

Gemfile:
= Copy to clipboard Copied!

install:
=

License:

Apache-2.0

Required Ruby Version: >= 2.7

Links: