tokenizers 0.4.0-x86_64-linux
Fast state-of-the-art tokenizers for Ruby
Gemfile:
=
Copy to clipboard
Copied!
install:
=
Versions:
- 0.4.2 - November 16, 2023 x86_64-linux (5.75 MB)
- 0.4.2 - November 16, 2023 x86_64-linux-musl (5.74 MB)
- 0.4.2 - November 16, 2023 x86_64-darwin (6 MB)
- 0.4.2 - November 16, 2023 arm64-darwin (5.86 MB)
- 0.4.2 - November 16, 2023 aarch64-linux (5.36 MB)
- 0.4.0 - September 21, 2023 x86_64-linux (5.72 MB)