Passer au contenu principal

Vocabulary of natural language processing

Choisissez le vocabulaire dans lequel chercher

  • Aide
aligner
annoter
télécharger

Concept information

... > NLP methods and tools > artificial intelligence > machine learning > machine learning approach > deep learning > layer normalization

Terme préférentiel

layer normalization  

Définition

  • A deep learning technique used to normalize the activations of neurons within each layer of a neural network independently in order to stabilize the training process and improve the performance of the neural network. (Based on Mudadla, Layer Normalization, on medium.com, 2023)

Concept générique

Exemple

  • Adding layer normalization after the embedding layer incurs a significant penalty on zero-shot generalization. (Le Scao, Wang, Hesslow, Bekman, Bari, Biderman, Elsahar, Muennighoff, Phang, Press, Raffel, Sanh, Shen, Sutawika, Tae, Yong, Launay & Beltagy, 2022)
  • The results show that layer normalization has no visible impact on MNIST. (Aji & Heafield, 2017)

Traductions

URI

http://data.loterre.fr/ark:/67375/8LP-QS6282WL-1

Télécharger ce concept :

RDF/XML TURTLE JSON-LD Dernière modification le 14/06/2024