Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 3 of 3 for “"Multi Teacher Knowledge Distillation"”.
-
Multi-Teacher Knowledge Distillation Using Teacher's Domain Expertise
… with low computing power and storage capacity. Knowledge Distillation solves this problem by distilling knowledge into a smaller BERT model while retaining much of the teacher’s accuracy in student. A teacher expert in predicting one class should be chosen, by student, over others for that class …
-
Securing Cyberspace: AI-Enabled Cyber-adversary Defense
… II adopts principles of text classification with multi-teacher knowledge distillation to link adversary assets to mitigation strategies in the MITRE ATT&CK framework. Essay III leverages text generation and adversarial training to robustify AI models against adversarial assets. Finally, Essay IV …
-
Robust and Efficient AI-models for Medical Image Reconstruction, Segmentation, and Multimodal Knowledge Distillation
… image reconstruction, semantic segmentation, multimodal knowledge integration, and adversarial robustness. I propose Teach-Former, a multi-teacher knowledge distillation framework that enables lightweight models to absorb rich spatial and contextual representations from multiple large …