As verbs the difference between tokenises and tokenizes
is that tokenises is third-person singular of tokenise while tokenizes is third-person singular of tokenize.
tokenizes
English
Verb
(head)
(tokenize)
tokenize
English
(Tokenization)
Verb
(computing) To reduce to a set of tokens by parsing.
To treat as a token minority.