Skip to main content

Vocabulary of natural language processing (POC)

Search from vocabulary

align
annotate
download

Concept information

... > NLP methods and tools > artificial intelligence > machine learning > machine learning model > neural networks model > neuron > layer > transformer layer

Preferred term

transformer layer  

Definition

  • A module found in a transformer that computes self-attention over a sequence followed by an elementwise transformation of the output vectors. (Based on Merrill and Sabharwal, The Parallelism Tradeoff: Limitations of Log-Precision Transformers, in Transactions of the Association for Computational Linguistics, 2023)

Broader concept

In other languages

URI

http://data.loterre.fr/ark:/67375/8LP-DMWDBJ9Z-N

Download this concept:

RDF/XML TURTLE JSON-LD Last modified 5/13/24