pragmatic_tokenizer 1.0.1

A multilingual tokenizer to split a string into tokens.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

3.2.0 - November 29, 2020 (71 KB)
3.1.0 - July 10, 2020 (70.5 KB)
3.0.7 - March 18, 2018 (70.5 KB)
3.0.6 - March 15, 2018 (72.5 KB)
3.0.5 - September 19, 2017 (72.5 KB)
1.0.1 - January 20, 2016 (54 KB)

Show all versions (54 total)

Runtime Dependencies (1):

unicode >= 0

Development Dependencies (4):

bundler ~> 1.9

rake ~> 10.0

rspec >= 0

stackprof >= 0

Show all transitive dependencies

Owners:

Authors:

Kevin S. Dias

SHA 256 checksum:

e2b4b6e1309f0fabb406164ec8881774b50c909c5d497d1e035825a475b562a8