octoleo
/
php-ml
mirror of https://github.com/Llewellynvdm/php-ml.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
php-ml/src/Tokenization
History
Pol Dellaiera 02dab41830 Provide a new NGramTokenizer with minGram and maxGram support (#350) 
* Issue #349: Provide a new NGramTokenizer.

* Issue #349: Add tests.

* Fixes from code review.

* Implement NGramTokenizer with min and max gram support

* Add missing tests for ngram

* Add info about NGramTokenizer to docs and readme

* Add performance test for tokenization
 		2019-02-15 17:31:10 +01:00
..
NGramTokenizer.php Provide a new NGramTokenizer with minGram and maxGram support (#350) 2019-02-15 17:31:10 +01:00
Tokenizer.php Enhancement: Flatten directory structure (#220) 2018-02-10 12:08:58 +01:00
WhitespaceTokenizer.php Update phpstan to 0.10.5 (#320) 2018-10-28 07:44:52 +01:00
WordTokenizer.php Enhancement: Flatten directory structure (#220) 2018-02-10 12:08:58 +01:00