Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 3 of 3 for “"Multi Teacher Knowledge Distillation"”.

  1. Multi-Teacher Knowledge Distillation Using Teacher's Domain Expertise

    … with low computing power and storage capacity. Knowledge Distillation solves this problem by distilling knowledge into a smaller BERT model while retaining much of the teacher’s accuracy in student. A teacher expert in predicting one class should be chosen, by student, over others for that class …

    ndsu Repository record for Multi-Teacher Knowledge Distillation Using Teacher's Domain Expertise (opens in a new tab)

  2. Securing Cyberspace: AI-Enabled Cyber-adversary Defense

    … II adopts principles of text classification with multi-teacher knowledge distillation to link adversary assets to mitigation strategies in the MITRE ATT&CK framework. Essay III leverages text generation and adversarial training to robustify AI models against adversarial assets. Finally, Essay IV …

    arizona-thes Repository record for Securing Cyberspace: AI-Enabled Cyber-adversary Defense (opens in a new tab)

  3. Robust and Efficient AI-models for Medical Image Reconstruction, Segmentation, and Multimodal Knowledge Distillation

    … image reconstruction, semantic segmentation, multimodal knowledge integration, and adversarial robustness. I propose Teach-Former, a multi-teacher knowledge distillation framework that enables lightweight models to absorb rich spatial and contextual representations from multiple large …

    unr Repository record for Robust and Efficient AI-models for Medical Image Reconstruction, Segmentation, and Multimodal Knowledge Distillation (opens in a new tab)