Pain Detection via Knowledge Distillation

OverviewResearch project investigating how teacher network architecture affects knowledge distillation quality for automated pain detection from facial expressions. Implemented and extended the DeiT-PNP architecture from El Morabit & Rivenq (2022), adapting it to the SynPain synthetic dataset and introducing a comparative teacher study — ResNet-50 vs. Swin Transformer — not present in the original paper.Research Question: How do different teacher network architectures (ResNet-50 and Swin Tra...