arXiv:2608.05250cs.LG2026-08

用轻量适配器实现多任务微调的精准回滚,提升模型性能。

Beyond Full-Model Rollback: AuroSFT for Adapter-State Multi-Task Fine-Tuning

论文配图:Beyond Full-Model Rollback: AuroSFT for Adapter-State Multi-Task Fine-Tuning
图 1 · 摘自论文原文
  • 以可合并的适配器状态替代完整模型检查点,降低存储与部署开销。
  • 在五种主干网络上均达到更高平均准确率(61.36%),优于基线方法。
  • 适合追求高效多任务训练与参数效率的研究者或工业应用。

多任务监督微调常将异构数据混合视为单一优化问题,尽管不同任务的最佳泛化可能出现在不同时期。msft通过任务级展开、排除和回滚揭示这一错配,但其原始形式将调度状态表现为完整模型检查点,导致阶段切换在存储、恢复和部署上代价高昂。本文提出AuroSFT,一种参数高效的框架,将过拟合感知的多任务SFT所携带的状态重构为紧凑且可合并的适配器状态。AuroSFT冻结预训练主干,仅训练注入的适配器,在任务级峰值处回滚适配器检查点,并在剩余活跃混合数据上继续训练。在层级别,每个适配器对低秩权重因子应用受AuroRA启发的自适应非线性层,而非作用于样本表示。所得更新在输入上保持线性、秩有界,并可精确合并至冻结投影。在保留主干的对比协议下,AuroSFT实现61.36%的平均准确率,高于对应msft参考行的59.85%,并在全部五个主干上均取得更高精度。代码已开源于匿名仓库:https://anonymous.4open.science/r/AuroSFT-80D1。

原文摘要 · Abstract (English)

Multi-task supervised fine-tuning (SFT) often casts a heterogeneous data mixture as a single optimization problem, even though different tasks may reach their best generalization at different times. msft exposes this mismatch through task-wise roll-out, exclusion, and rollback, but its original formulation materializes the scheduler state as full-model checkpoints, making stage transitions costly to store, restore, and deploy. This paper introduces AuroSFT, a parameter-efficient framework that recasts the carried state of overfitting-aware multi-task SFT as a compact, mergeable adapter state. AuroSFT freezes the pretrained backbone, trains only injected adapters, rolls back adapter checkpoints at task-wise peaks, and continues on the remaining active mixture. At the layer level, each adapter applies an AuroRA-inspired adaptive nonlinear layer to a low-rank weight factor rather than to the sample representation. The resulting update remains linear in the input, rank-bounded, and exactly mergeable into the frozen projection. Under the retained-backbone comparison protocol, AuroSFT achieves 61.36% average accuracy, compared with 59.85% for the corresponding msft reference row, and obtains higher accuracy on all five backbones. Our code is available at the anonymous repository: https://anonymous.4open.science/r/AuroSFT-80D1.

多任务学习适配器微调参数效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。