WeWorkBuddy

Janus-MOPD: Tracing the Student Learning Dynamics in Multi-Teacher On-Policy Distillation

arXiv:2611.15341v1 Announce Type: new Abstract: Multi-domain capabilities are critical for practically applicable Large Reasoning Models (LRMs). Therefore, Multi-teacher On-Policy Distillation (MOPD) has become a crucial part of the post-training process, integrating the capabilities of multiple domain-specific teacher models into a single student model. However, the student usually fails to acquire multi-domain capabilities simultaneously due to undesirable domain heterogeneity. Existing works

阅读原始来源
来源参考:Janus-MOPD: Tracing the Student Learning Dynamics in Multi-Teacher On-Policy Distillation。暂未取得截图。
来源记录 · 预览待采集 · arxiv.org打开来源查看完整网页。

来源记录

项目分析

暂无五维分析,可先查看上方来源资料。