arXiv:2605.20803cs.LGcs.AI2026-05中稿 · ICPR 2026

让持续学习模型按需调整表现,适配不同使用场景。

Tunable MAGMAX: Preference-Aware Model Merging for Continual Learning

  • 用偏好向量控制合并时各任务参数的选取数量。
  • 仅需少量目标环境数据即可自动生成偏好向量。
  • 适合需要灵活调节任务性能的部署场景。

持续学习(CL)旨在顺序训练模型处理多个任务的同时缓解灾难性遗忘。近年来,大型预训练模型(LPMs)与模型合并技术(如MAGMAX)通过整合任务特定参数展现了出色的CL性能。然而,现有方法主要关注所有任务的平均表现,未充分考虑如何构建适应不同部署环境或用户偏好的模型。本文提出一种可调的模型合并框架——Tunable MAGMAX,实现对持续学习中任务特定性能的偏好感知控制。该方法引入偏好向量,用于调控合并过程中从每个任务向量中选取的元素数量,从而根据部署需求调整合并模型的表现。我们进一步提出一种基于少量目标环境数据和训练任务数据自动构造合适偏好向量的方法,避免手动指定。在CL基准任务上的实验表明,Tunable MAGMAX能有效控制各任务性能,并成功适应多种目标环境。所提方法在性能上优于或媲美基线,是适用于任务性能偏好各异的部署场景的实际解决方案。

原文摘要 · Abstract (English)

Continual learning (CL) aims to train models sequentially on multiple tasks while mitigating catastrophic forgetting of previously learned knowledge. Recent advances in large pre-trained models (LPMs) and model merging techniques, such as MAGMAX, have demonstrated effective CL performance by combining task-specific parameters. However, existing methods primarily focus on average performance across all tasks and do not adequately address how to construct models accommodating different deployment environments or varying user preferences. This paper proposes a model merging framework, termed Tunable MAGMAX, which enables preference-aware control of task-specific performance in CL. Our method introduces a preference vector that controls the number of elements selected from each task vector during model merging, allowing us to adjust the merged model performance according to their deployment needs. We further propose a method for automatically constructing appropriate preference vectors by leveraging small amounts of target environment data and datasets from model training tasks, thereby eliminating the need for manual specification. The experimental result on CL benchmark tasks demonstrates that Tunable MAGMAX effectively controls task-wise performance and successfully adapts merged models to various target environments. The proposed Tunable MAGMAX achieves superior or comparable performance to baseline methods, making it a practical solution for deploying CL models to various environments where the preferences of each task performance differ.

持续学习模型合并偏好控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。