用图结构先验和模块化适配器,让大模型多任务微调更高效稳定
Structural Priors and Modular Adapters in the Composable Fine-Tuning Algorithm of Large-Scale Models
- 引入关系矩阵建模任务间依赖,指导适配器权重分配与路径选择
- 模块化适配器跨任务复用,提升参数效率并减少冗余计算
- 适合需要多任务高效微调的场景,尤其关注稳定性与轻量化
本文提出一种可组合微调方法,通过融合图结构先验与模块化适配器,解决大规模预训练模型在多任务适应中计算成本高、结构不稳定的难题。该方法引入关系矩阵建模任务间的依赖关系,将节点与路径间的相关性显式编码为图结构先验,统一约束适配器权重分配与路径选择。模块化适配器通过低秩映射与即插即用机制嵌入不同层,实现高效跨任务组合与复用,在先验引导下提升参数效率与训练稳定性,缓解多任务场景中的路径冲突与冗余计算。实验系统分析了路由温度、门控阈值与关系矩阵正则强度等超参数敏感性,验证了方法在结构约束下的一致性与优越性能。结果表明,该框架显著提升任务预测准确率、适配器权重分配精度与整体计算效率,同时保持轻量化设计,凸显图先验与模块化机制在可组合微调中的协同优势。
原文摘要 · Abstract (English)
This paper proposes a composable fine-tuning method that integrates graph structural priors with modular adapters to address the high computational cost and structural instability faced by large-scale pre-trained models in multi-task adaptation. The method introduces a relation matrix to model dependencies among tasks, explicitly encoding correlations between nodes and paths into graph structural priors, which provide unified structural constraints for adapter weight allocation and path selection. Modular adapters are embedded into different layers through low-rank mapping and a pluggable mechanism, enabling efficient cross-task composition and reuse under prior guidance. This mechanism not only improves parameter efficiency and training stability but also alleviates path conflicts and redundant computation in multi-task scenarios. Furthermore, experiments on hyperparameter sensitivity, environmental sensitivity, and data sensitivity are conducted to systematically analyze key factors such as routing temperature, gating thresholds, and relation matrix regularization strength, verifying the consistency and superior performance of the method under structural constraints. The results demonstrate that the proposed framework significantly enhances task prediction accuracy, adapter weight allocation precision, and overall computational efficiency while maintaining model lightweight design, highlighting the synergistic advantages of graph priors and modular mechanisms in composable fine-tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。