terms |
tokenizes |
As a noun terms
is .
As a verb tokenizes is
(
tokenize).
tokenizes |
tokenizers |
As a verb tokenizes
is third-person singular of tokenize.
As a noun tokenizers is
plural of tokenizer.
tokenises |
tokenizes |
As verbs the difference between tokenises and tokenizes
is that
tokenises is third-person singular of tokenise while
tokenizes is third-person singular of tokenize.
tokenizes |
tokenized |
As verbs the difference between tokenizes and tokenized
is that
tokenizes is third-person singular of tokenize while
tokenized is past tense of tokenize.
tokenizes |
tokenizer |
As a verb tokenizes
is third-person singular of tokenize.
As a noun tokenizer is
a system that parses an input stream into tokens.