WeWorkBuddy

Janus-MOPD: Tracing the Student Learning Dynamics in Multi-Teacher On-Policy Distillation

arXiv:2611.15341v1 Announce Type: new Abstract: Multi-domain capabilities are critical for practically applicable Large Reasoning Models (LRMs). Therefore, Multi-teacher On-Policy Distillation (MOPD) has become a crucial part of the post-training process, integrating the capabilities of multiple domain-specific teacher models into a single student model. However, the student usually fails to acquire multi-domain capabilities simultaneously due to undesirable domain heterogeneity. Existing works

Read original source
Source reference for Janus-MOPD: Tracing the Student Learning Dynamics in Multi-Teacher On-Policy Distillation. Screenshot not yet available.
Source record · preview pending · arxiv.orgOpen the source for the full page.

Source record

Project analysis

Project analysis is not yet available. See the source record above.