php-ml/src/Phpml/Tokenization/Tokenizer.php

<?php

declare(strict_types=1);

namespace Phpml\Tokenization;

interface Tokenizer
{
    public function tokenize(string $text): array;
}
create whitespace tokenizer 2016-05-02 22:33:18 +00:00			`<?php`

Update php-cs-fixer 2016-11-20 21:53:17 +00:00			`declare(strict_types=1);`
create whitespace tokenizer 2016-05-02 22:33:18 +00:00
			`namespace Phpml\Tokenization;`

			`interface Tokenizer`
			`{`
Added EasyCodingStandard + lots of code fixes (#156) * travis: move coveralls here, decouple from package * composer: use PSR4 * phpunit: simpler config * travis: add ecs run * composer: add ecs dev * use standard vendor/bin directory for dependency bins, confuses with local bins and require gitignore handling * ecs: add PSR2 * [cs] PSR2 spacing fixes * [cs] PSR2 class name fix * [cs] PHP7 fixes - return semicolon spaces, old rand functions, typehints * [cs] fix less strict typehints * fix typehints to make tests pass * ecs: ignore typehint-less elements * [cs] standardize arrays * [cs] standardize docblock, remove unused comments * [cs] use self where possible * [cs] sort class elements, from public to private * [cs] do not use yoda (found less yoda-cases, than non-yoda) * space * [cs] do not assign in condition * [cs] use namespace imports if possible * [cs] use ::class over strings * [cs] fix defaults for arrays properties, properties and constants single spacing * cleanup ecs comments * [cs] use item per line in multi-items array * missing line * misc * rebase 2017-11-22 21:16:10 +00:00			`public function tokenize(string $text): array;`
create whitespace tokenizer 2016-05-02 22:33:18 +00:00			`}`