Skip to main

Vocabulary of natural language processing

Search from vocabulary

Concept information

Término preferido

token  

Definición

  • In lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence. (Wikidata)

Concepto genérico

Conceptos específicos

Ejemplo

  • Given a sentence these methods predict whether each token is an event trigger and what type of event it triggered. (Liu, Li, Zhang, Yang & Zhou, 2019)
  • Our model assigned each token with nearly equivalent attention score. (Liu, Li, Zhang, Yang & Zhou, 2019)

En otras lenguas

URI

http://data.loterre.fr/ark:/67375/8LP-TX1JH6ZL-6

Descargue este concepto:

RDF/XML TURTLE JSON-LD última modificación 14/6/24