pragmatic_tokenizer 1.6.0

A multilingual tokenizer to split a string into tokens.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

3.2.0 - November 29, 2020 (71 KB)
3.1.0 - July 10, 2020 (70.5 KB)
3.0.7 - March 18, 2018 (70.5 KB)
3.0.6 - March 15, 2018 (72.5 KB)
3.0.5 - September 19, 2017 (72.5 KB)
1.6.0 - January 27, 2016 (71.5 KB)

Show all versions (54 total)

Runtime Dependencies (1):

unicode >= 0

Development Dependencies (5):

bundler ~> 1.9

rake ~> 10.0

rspec >= 0

rubocop >= 0

stackprof >= 0

Show all transitive dependencies

Owners:

Authors:

Kevin S. Dias

SHA 256 checksum:

2e401f1ea06228d937dd5746c80e8c139ed22a3b8f43993518c45a22df7acd61