Janus-MOPD: Tracing the Student Learning Dynamics in Multi-Teacher On-Policy Distillation
arXiv:2611.15341v1 Announce Type: new Abstract: Multi-domain capabilities are critical for practically applicable Large Reasoning Models (LRMs). Therefore, Multi-teacher On-Policy Distillation (MOPD) has become a crucial part of the post-training process, integrating the capabilities of multiple domain-specific teacher models into a single student model. However, the student usually fails to acquire multi-domain capabilities simultaneously due to undesirable domain heterogeneity. Existing works
Read original sourceSource record
Project analysis
Project analysis is not yet available. See the source record above.