: NLP Vocabulary: teacher model

... > artificial intelligence > machine learning > machine learning model > neural networks model > teacher model

teacher model

A large neural network model used to impart knowledge and supervision when training student models through techniques such as knowledge distillation.

In the first phase a teacher model is utilized to reflect on the instruction of the given sample based on some criteria and generate a new sample. (Li, Chen, Chen, He, Gu & Zhou, 2024)
In the second phase the teacher model reflects and generates a sample with a new response and the student model decides whether to accept based on feasibility (r-IFD). (Li, Chen, Chen, He, Gu & Zhou, 2024)
Meanwhile the goal of KD is to transfer the knowledge from teacher models to student models. (Wu, Hou, Lao, Li, Wong, Zhao & Yang, 2024)

http://data.loterre.fr/ark:/67375/8LP-WG66S2KX-2

RDF/XML TURTLE JSON-LD Last modified 5/15/24

Loterre