Concept information
Término preferido
teacher model
Definición
- A large neural network model used to impart knowledge and supervision when training student models through techniques such as knowledge distillation.
Concepto genérico
Ejemplo
- In the first phase a teacher model is utilized to reflect on the instruction of the given sample based on some criteria and generate a new sample. (Li, Chen, Chen, He, Gu & Zhou, 2024)
- In the second phase the teacher model reflects and generates a sample with a new response and the student model decides whether to accept based on feasibility (r-IFD). (Li, Chen, Chen, He, Gu & Zhou, 2024)
- Meanwhile the goal of KD is to transfer the knowledge from teacher models to student models. (Wu, Hou, Lao, Li, Wong, Zhao & Yang, 2024)
En otras lenguas
-
francés
URI
http://data.loterre.fr/ark:/67375/8LP-WG66S2KX-2
{{label}}
{{#each values }} {{! loop through ConceptPropertyValue objects }}
{{#if prefLabel }}
{{/if}}
{{/each}}
{{#if notation }}{{ notation }} {{/if}}{{ prefLabel }}
{{#ifDifferentLabelLang lang }} ({{ lang }}){{/ifDifferentLabelLang}}
{{#if vocabName }}
{{ vocabName }}
{{/if}}