: NLP Vocabulary: self-attention layer

... > machine learning model > neural networks model > neuron > layer > self-attention layer

self-attention layer

A layer in the architecture of transformer-based models that allows the model to focus on different parts of the input sequence when processing each token to capture contextual relationships and dependencies within the input sequence.

http://data.loterre.fr/ark:/67375/8LP-DMDVS16W-4

RDF/XML TURTLE JSON-LD Last modified 5/13/24

Loterre