Skip to main

Vocabulary of natural language processing

Search from vocabulary

Concept information

Término preferido

teacher model  

Definición

  • A large neural network model used to impart knowledge and supervision when training student models through techniques such as knowledge distillation.

Concepto genérico

Ejemplo

  • In the first phase a teacher model is utilized to reflect on the instruction of the given sample based on some criteria and generate a new sample. (Li, Chen, Chen, He, Gu & Zhou, 2024)
  • In the second phase the teacher model reflects and generates a sample with a new response and the student model decides whether to accept based on feasibility (r-IFD). (Li, Chen, Chen, He, Gu & Zhou, 2024)
  • Meanwhile the goal of KD is to transfer the knowledge from teacher models to student models. (Wu, Hou, Lao, Li, Wong, Zhao & Yang, 2024)

En otras lenguas

URI

http://data.loterre.fr/ark:/67375/8LP-WG66S2KX-2

Descargue este concepto:

RDF/XML TURTLE JSON-LD última modificación 15/5/24