Passer au contenu principal

Vocabulary of natural language processing

Choisissez le vocabulaire dans lequel chercher

  • Aide
aligner
annoter
télécharger

Concept information

... > NLP methods and tools > model > statistical model > foundation model > language model > UniLM
... > NLP methods and tools > statistics > statistical model > foundation model > language model > UniLM

Terme préférentiel

UniLM  

Définition

  • Language model pre-trained using three types of language modeling tasks: unidirectional, bidirectional, and sequence-to-sequence prediction. (Dong et al., 2019)

Concept générique

Synonyme(s)

  • UNIfied pre-trained Language Model

Exemple

  • It shows that UniLM is stronger than BERT in modeling news texts and thereby we used UniLM for learning and distilling our models. (Wu, Wu, Yu, Qi, Huang & Liu, 2021)
  • The UniLM model is also fine-tuned with an additional extractive summarization objective to predict relevant sentences in the document; this objective could be beneficial to generate the CNN/DailyMail extracts. (Rothe, Narayan & Severyn, 2020)

Traductions

URI

http://data.loterre.fr/ark:/67375/8LP-ZVRTVWP6-K

Télécharger ce concept :

RDF/XML TURTLE JSON-LD Dernière modification le 26/04/2024