Run :
Train Teacher model:
CUDA_VISIBLE_DEVICES=0 python -m torch.distributed.launch \
--nproc_per_node=1 \
--master_port 51321 \
run_teacher.py \
Train Student model by adding teacher path (-t)
CUDA_VISIBLE_DEVICES=0 python -m torch.distributed.launch \
--nproc_per_node=1 \
--master_port 51321 \
pspd.py \
-b 64 \
--epochs 300 \
--lr 0.0003 \
--data /path/to/data \