Skip to main

Vocabulary of natural language processing

Search from vocabulary

  • Ayuda
mapear
anotar
descargar

Concept information

... > NLP methods and tools > model > statistical model > foundation model > language model > ALUM
... > NLP methods and tools > statistics > statistical model > foundation model > language model > ALUM

Término preferido

ALUM  

Definición

  • Language model which regularizes the training objective by applying perturbations in the embedding space that maximizes the adversarial loss (Liu et al., 2020).

Concepto genérico

Etiquetas alternativas

  • Adversarial training for large neural LangUage Models

Contexto(s) definitorio(s)

  • ALUM (Liu et al. 2020) is the state-of-theart adversarial training method for neural language models which regularizes fine-tuning via perturbations in the embedding space. (Chen, Shen, Chen & Yang, 2021)

Ejemplo

  • Both ALUM and InfoBERT take RoBERTa-large as the backbone model. (Chen, Zhang & Zhao, 2022)

En otras lenguas

URI

http://data.loterre.fr/ark:/67375/8LP-FZWTVBWP-M

Descargue este concepto:

RDF/XML TURTLE JSON-LD última modificación 26/4/24