BoostLoRA: Growing Effective Rank by Boosting Adapters
arXiv:2604.27308v2 Announce Type: replace-cross Abstract: Parameter-efficient fine-tuning (PEFT) methods face a tradeoff between adapter size and expressivity: ultra-low-parameter adapters are confined to fixed low-rank subspaces, capping performance even with extended training. We propose BoostLoRA, a gradient-boosting framework that overcomes this limit by iteratively training and merging minimal adapters on the examples the current model gets wrong. A ROTATE SVD basis strategy assigns each ro
阅读原始来源来源记录
项目分析
暂无五维分析,可先查看上方来源资料。