Localized LoRA-MoE: Mixture of Low-Rank Experts With Adaptive Routing
arXiv:2607.05114v2 Announce Type: replace-cross Abstract: Parameter-efficient fine-tuning (PEFT) methods such as LoRA adapt large models through a single low-rank update. Such updates are susceptible to gradient interference: when a training stream interleaves multiple operational contexts, conflicting updates to shared adapter weights collapse the adapter into an unspecialized average. While recent methods introduce block-wise isolation to remedy this issue, their topologies are static and cann
阅读原始来源来源记录
项目分析
暂无五维分析,可先查看上方来源资料。