Commit Graph

4 Commits

Author SHA1 Message Date
KenorFR
cefb4fc7a7 Ngram word (#370)
* Add NGramWordTokenizer

* Update doc
Add test
Check coding standards
2019-04-05 21:23:09 +02:00
Pol Dellaiera
02dab41830 Provide a new NGramTokenizer with minGram and maxGram support (#350)
* Issue #349: Provide a new NGramTokenizer.

* Issue #349: Add tests.

* Fixes from code review.

* Implement NGramTokenizer with min and max gram support

* Add missing tests for ngram

* Add info about NGramTokenizer to docs and readme

* Add performance test for tokenization
2019-02-15 17:31:10 +01:00
Marcin Michalski
53c5a6b9e5 Update phpstan to 0.10.5 (#320) 2018-10-28 07:44:52 +01:00
Andreas Möller
4b5d57fd6f Enhancement: Flatten directory structure (#220) 2018-02-10 12:08:58 +01:00