Concept information
Preferred term
DeBERTa
Definition
- Modèle de langage neuronal basé sur un transformeur, DeBERTa (Decoding-enhanced BERT with disentangled attention), repose sur un nouveau mécanisme d'attention démêlée un décodeur de masques amélioré (He et al., 2020).
Broader concept
Bibliographic citation(s)
- • He, P., Liu, X., Gao, J., & Chen, W. (2020). DeBERTa: Decoding-enhanced BERT with Disentangled Attention. https://arxiv.org/abs/2006.03654v1
based on
has application field
has for input language
has repository
implements
is encoded in
is executed in
has for license
In other languages
-
English
-
Decoding-enhanced BERT with disentangled attention
URI
http://data.loterre.fr/ark:/67375/LTK-G64XHKJT-9
{{label}}
{{#each values }} {{! loop through ConceptPropertyValue objects }}
{{#if prefLabel }}
{{/if}}
{{/each}}
{{#if notation }}{{ notation }} {{/if}}{{ prefLabel }}
{{#ifDifferentLabelLang lang }} ({{ lang }}){{/ifDifferentLabelLang}}
{{#if vocabName }}
{{ vocabName }}
{{/if}}