RubyGems Navigation menu

j_r_r_token 1.0.4-arm64-darwin

JRRToken is a Ruby gem that wraps the tiktoken Rust library, enabling fast and efficient tokenization for OpenAI models. It supports multiple models including o200k_base, cl100k_base, p50k_base, p50k_edit, and r50k_base.

Gemfile:
=

install:
=

Versions:

  1. 1.1.0 August 27, 2025 x86_64-linux-musl (24.6 MB)
  2. 1.1.0 August 27, 2025 x86_64-darwin (23.9 MB)
  3. 1.1.0 August 27, 2025 arm64-darwin (23.9 MB)
  4. 1.1.0 August 27, 2025 x86_64-linux (24.6 MB)
  5. 1.1.0 August 27, 2025 aarch64-linux-musl (24.3 MB)
  6. 1.0.4 August 02, 2025 arm64-darwin (23.9 MB)
Show all versions (31 total)

Development Dependencies (3):

bundler >= 2.0
rake ~> 13.0
rake-compiler >= 0
Show all transitive dependencies

Owners:

Pushed by:

Authors:

  • Logan Bresnahan

SHA 256 checksum:

=
← Previous version Next version →

Total downloads 4,772

For this version 130

Version Released:

License:

MIT

Required Ruby Version: >= 2.7, < 3.5.dev

Required Rubygems Version: >= 3.0.0

Links:

Homepage Changelog Download Review changes Badge Subscribe RSS Report abuse Reverse dependencies