RubyGems
Blog
Stats
Docs
About
RubyGems.org
Status
Data
Security
Help
RubyGems
Blog
Stats
Docs
About
RubyGems.org
Status
Data
Security
Help
Sign in
Sign up
RubyGems
Profile
Edit profile
Settings
Sign out
Search Gems…
riktoken
0.0.1 (latest)
Gem info
Dependencies
Gemfile
install
A pure Ruby implementation of OpenAI's tiktoken library for BPE tokenization
Required Ruby Version
>= 3.1.0
Authors
moznion
Versions
0.0.1
June 04, 2025
(14.5 KB)
Pushed by
moznion
SHA 256 checksum