gtokenizer 1.0.0
GTokenizer recreates the closed-source tokenization library used by Google for their Google NGrams app (http://ngrams.googlelabs.com/), based on the information in the associated Science paper (http://www.sciencemag.org/content/suppl/2010/12/16/science.1199644.DC1/Michel.SOM.revision.2.pdf)
Gemfile:
=
Copy to clipboard
Copied!
install:
=
Versions:
- 1.0.0 - July 02, 2011 (6.5 KB)
Development Dependencies (1):
rspec
>= 0
Owners:
Authors:
-
Alex Peattie
SHA 256 checksum:
7eb5615caee4e15a2d5baa63577f3dce14dc361940725e2e7f72b976df7704a3