arXiv:2605.03555cs.CV2026-05中稿 · ICPR 2026

MILE用轻量专家模块实现跨领域跨模态持续分割,不遗忘旧任务且参数增长极少。

MILE: Mixture of Incremental LoRA Experts for Continual Semantic Segmentation across Domains and Modalities

论文配图:MILE: Mixture of Incremental LoRA Experts for Continual Semantic Segmentation across Domains and Modalities
图 1 · 摘自论文原文
  • 每新任务生成一个轻量LoRA专家,冻结主干网络避免覆盖旧知识。
  • 仅需数十个LoRA适配器,总参数量远低于完整模型,训练存储高效。
  • 原型引导门控机制动态选择专家,适合长期多任务持续学习场景。

持续语义分割要求模型在不损害已有任务性能的前提下适应新领域或新模态。基于专家的学习方法通过为不同领域分配专用模块,有效缓解遗忘问题。现有方法存在动态扩展可扩展性差或参数隔离限制新任务学习能力的缺陷。本文提出混合增量LoRA专家(MILE)框架,实现跨领域与跨模态的持续分割。MILE利用低秩适配(LoRA)为每个新任务创建轻量级专家,同时保持预训练主干网络冻结。每个专家仅在对应任务数据上训练,避免覆盖先前学习的信息。推理时采用原型引导的门控机制动态选择最合适的专家。MILE兼具专家学习优势并克服其可扩展性瓶颈:每新增任务仅需极少量参数,数十个LoRA适配器总量仍远小于单个完整模型,显著提升训练与存储效率。在领域与模态增量基准测试中,MILE表现优异,兼具更强的稳定性、可塑性与可扩展性。

原文摘要 · Abstract (English)

Continual semantic segmentation requires models to adapt to new domains or modalities without sacrificing performance on previously learned tasks. Expert-based learning, in which task-specific modules specialize in different domains, has proven effective in mitigating forgetting. These methods include dynamic expansion, which suffers from scalability issues, or parameter isolation, which constrains the ability to learn new tasks. We introduce Mixture of Incremental LoRA Experts (MILE), a modular and parameter-efficient framework for continual segmentation across both domains and modalities. MILE leverages Low-Rank Adaptation (LoRA) to instantiate lightweight experts for each new task while keeping the pretrained base network frozen. Each expert is trained exclusively on its task data, thus avoids overwriting previously learned information. A prototype-guided gating mechanism dynamically selects the most appropriate expert at inference. MILE achieves the benefits of expert-based learning while overcoming its scalability limitations. It requires only a marginal parameter increase per task and tens of LoRA adapters are needed before matching the size of a single full model, making it highly efficient in both training and storage. Across domain- and modality-incremental benchmarks, MILE achieves strong performance while ensuring better stability, plasticity, and scalability.

持续学习语义分割LoRA专家系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。