tokenizers 0.4.1
Fast state-of-the-art tokenizers for Ruby
Gemfile:
=
Copier
Copié!
installation:
=
Versions:
- 0.5.2 - August 26, 2024 x86_64-linux (5,89 Mo)
- 0.5.2 - August 26, 2024 x86_64-linux-musl (5,87 Mo)
- 0.5.2 - August 26, 2024 x86_64-darwin (6,16 Mo)
- 0.5.2 - August 26, 2024 arm64-darwin (5,86 Mo)
- 0.5.2 - August 26, 2024 aarch64-linux (5,44 Mo)
- 0.4.1 - October 05, 2023 (37,5 ko)
Dépendances de Runtime (1):
rb_sys
>= 0