Passer au contenu principal

Vocabulary of natural language processing

Choisissez le vocabulaire dans lequel chercher

  • Aide
aligner
annoter
télécharger

Concept information

... > NLP methods and tools > model > statistical model > foundation model > language model > byT5
... > NLP methods and tools > statistics > statistical model > foundation model > language model > byT5

Terme préférentiel

byT5  

Définition

  • Pre-trained byte-level Transformer models based on the T5 architecture. (Xue et al., 2022)

Concept générique

Exemple

  • We see that byT5 alone achieves excellent BLEU scores. (Jude Ogundepo, Oladipo, Adeyemi, Ogueji & Lin, 2022)
  • Whereas byT5 only uses byte sequences instead of subwords and differs in hyperparameters Charformer uses convolution and combines character blocks to obtain latent subword representations. (Libovický, Schmid & Fraser, 2022)

Traductions

URI

http://data.loterre.fr/ark:/67375/8LP-ZS8B6SL1-Z

Télécharger ce concept :

RDF/XML TURTLE JSON-LD Dernière modification le 26/04/2024