RubyGems Navigation menu

pragmatic_tokenizer 2.2.1

A multilingual tokenizer to split a string into tokens.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

  1. 3.2.0 - November 29, 2020 (71 KB)
  2. 3.1.0 - July 10, 2020 (70.5 KB)
  3. 3.0.7 - March 18, 2018 (70.5 KB)
  4. 3.0.6 - March 15, 2018 (72.5 KB)
  5. 3.0.5 - September 19, 2017 (72.5 KB)
  6. 2.2.1 - February 16, 2016 (72.5 KB)
Show all versions (54 total)

Runtime Dependencies (1):

Development Dependencies (5):

bundler ~> 1.9
rake ~> 10.0
rspec >= 0
rubocop >= 0
stackprof >= 0

Owners:

Authors:

  • Kevin S. Dias

SHA 256 checksum:

d74a64513347ba6ccb9058fd2438261f2b844b7597ccf9df49dd7c1b043af502

Total downloads 220,345

For this version 2,555

Licenses:

N/A

Required Ruby Version: >= 0

Links: