Skip to main

Thesaurus of Text Mining (ThesoTM)

Search from vocabulary

Concept information

Término preferido

tokenization  

Notice: Undefined index: in /var/www/html/model/Concept.php on line 545

Definición

  • The task/process of recognizing and tagging tokens (words, punctuation marks, digits etc.) in a text.

Concepto genérico

Nota de alcance

  • The task/process of recognizing and tagging tokens (words, punctuation marks, digits etc.) in a text

En otras lenguas

URI

http://data.loterre.fr/ark:/67375/LTK-T5RXB3DL-2

Descargue este concepto: