tokenizers 0.3.1
Fast state-of-the-art tokenizers for Ruby
Gemfile:
=
instalar:
=
Versiones:
- 0.5.3 September 17, 2024 x86_64-linux (5,91 MB)
- 0.5.3 September 17, 2024 x86_64-linux-musl (5,89 MB)
- 0.5.3 September 17, 2024 x86_64-darwin (6,17 MB)
- 0.5.3 September 17, 2024 x64-mingw-ucrt (8,09 MB)
- 0.5.3 September 17, 2024 arm64-darwin (5,87 MB)
- 0.3.1 February 09, 2023 (35,5 KB)
dependencias de Runtime (1):
rb_sys
>= 0