无需标签,自动调节多领域训练参与度,提升协同学习效果。
Co-Adaptive Multi-Task LoRA: Transfer-Aware, Label-Free Control of Domain Participation

- 用无标签小样本探针实时评估各领域学习潜力和互斥关系。
- 动态调整每个领域的损失权重与数据占比,提升平均性能2.3%以上。
- 无需新增参数,适配任意多任务LoRA框架,适合资源受限场景。
同时微调多个领域的单一低秩适配器属于多任务学习:各领域需协同学习,共享适配器的方式决定其是否相互促进或干扰。现有高效微调方法忽略此问题,采用固定均匀混合策略,未解决两个关键问题:各领域应参与多少,哪些领域应共同训练(因部分迁移正向,部分产生干扰)?本文证明,仅通过一次前向传播即可低成本获取答案。对少量无标签探针进行前向计算,可得到每域的胜任度信号——其水平反映剩余学习空间,轨迹反映学习速度;探针表示的漂移则生成有符号的跨域亲和性,可预测成对迁移效果。我们将两者融入CoDA,一个联合优化的自适应控制器,通过求解一个小规模熵正则化二次规划,在单纯形上设定各域参与度(即损失权重与采样占比),奖励高潜力、仍在学习、互惠的领域,抑制干扰项。该控制器仅前向运行,不增加可训练参数,可封装任何多任务LoRA流程。在五个异构领域及两种主干网络上,CoDA在仅使用一半数据的情况下,超越均匀混合、学习混合、梯度手术优化器与在线数据选择,平均性能提升2.3%,并降低跨域梯度冲突。我们证明了胜任度信号跟踪域风险,参与度程序具有唯一不动点,且其解等价于转移感知的水填法;分析、消融实验与对照验证了所有结论。
原文摘要 · Abstract (English)
Fine-tuning a single low-rank adapter on many domains at once is multi-task learning: the domains must be co-learned, and how they share the adapter decides whether they help or hurt one another. Most efficient fine-tuning pipelines ignore this and train on a fixed, uniform mixture, leaving two coupled questions unanswered: how much should each domain participate, and which domains should be co-trained given that some transfer positively and others interfere? We show that both answers can be read off cheaply and without labels. A forward pass of the current shared adapter over a small unlabeled probe yields, per domain, a competence signal whose level tracks remaining headroom and whose trajectory tracks learning speed; the drift of these probe representations yields a signed cross-domain affinity that predicts pairwise transfer. We fold both into CoDA, a co-adaptive controller that solves a small entropy-regularized quadratic program on the simplex to set each domain's participation -- jointly its loss weight and its share of the sampled data -- rewarding high-headroom, still-learning, mutually synergistic domains and damping interfering ones. The controller is forward-only, adds no trainable parameters, and wraps any multi-task LoRA pipeline. Across five heterogeneous domains and two backbones, CoDA improves the average over uniform mixing, learned mixtures, gradient-surgery multi-task optimizers, and online data selection while using half the data, and lowers cross-domain gradient conflict. We prove that the competence signal tracks domain risk, that the participation program has a unique fixed point reached by a contraction, and that its solution performs transfer-aware water-filling; analysis, ablations, and controls corroborate each claim.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。