tokenizers 0.3.3

Fast state-of-the-art tokenizers for Ruby

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

0.4.2 - November 16, 2023 x86_64-linux (5.75 MB)
0.4.2 - November 16, 2023 x86_64-linux-musl (5.74 MB)
0.4.2 - November 16, 2023 x86_64-darwin (6 MB)
0.4.2 - November 16, 2023 arm64-darwin (5.86 MB)
0.4.2 - November 16, 2023 aarch64-linux (5.36 MB)
0.3.3 - April 09, 2023 (36.5 KB)

Show all versions (62 total)

Runtime Dependencies (1):

rb_sys >= 0

Show all transitive dependencies

Owners:

Pushed by:

Authors:

Andrew Kane

SHA 256 checksum:

0541815fde15c79e5d23642b1ee2c90cfad90fd6e57c2125c186aee6ac8622fb