tokenizers 0.5.1
Fast state-of-the-art tokenizers for Ruby
Gemfile:
=
installation:
=
Versions:
- 0.5.3 September 17, 2024 x86_64-linux (5,91 Mo)
- 0.5.3 September 17, 2024 x86_64-linux-musl (5,89 Mo)
- 0.5.3 September 17, 2024 x86_64-darwin (6,17 Mo)
- 0.5.3 September 17, 2024 x64-mingw-ucrt (8,09 Mo)
- 0.5.3 September 17, 2024 arm64-darwin (5,87 Mo)
- 0.5.1 August 13, 2024 (38 ko)
Dépendances de Runtime (1):
rb_sys
>= 0
Propriétaires:
Pushed by:
Auteurs:
-
Andrew Kane
Total de contrôle SHA 256:
=