arXiv:2605.31229cs.CVcs.AI2026-05被引 1

提出动态适配器路由,提升多模态检索的持续学习能力

Beyond Classification: Dynamic Adapter Routing for Continual Multimodal Retrieval

论文配图:Beyond Classification: Dynamic Adapter Routing for Continual Multimodal Retrieval
图 1 · 摘自论文原文
  • 通过原型路由选择适配器,动态组合实现高效检索
  • 在跨域场景下优于现有基线,外分布测试表现更稳健
  • 适合研究持续学习与多模态检索的学者参考

尽管检索是视觉-语言模型的核心功能,但针对检索任务的持续更新仍严重缺乏研究。现有工作通常以类别增量学习(CIL)视角处理持续检索,评估标准可能未能充分反映检索特有的动态特性。为此,我们提出一种新的、严谨的持续多模态检索(CMR)评估框架,覆盖多样视觉领域,并系统评估常见方法在此设定下的表现。实证分析表明,标准CIL方法在更复杂场景下无法带来有效提升。因此,我们提出动态适配器路由(DAR),基于原型路由选择适配器并采用模型融合方式结合。DAR在性能上超越先前基线,在分布外评估中展现出强泛化能力。结果凸显了CMR的独特挑战,推动该方向的进一步研究。

原文摘要 · Abstract (English)

While retrieval is a core function of vision-language models, continually updating these models for retrieval tasks remains critically underexplored. Existing work often approaches continual retrieval through the lens of class-incremental learning (CIL), evaluating both standard CIL methods and retrieval-oriented adaptations in settings that may not fully capture the retrieval-specific dynamics. To address this, we introduce a new, principled evaluation framework for continual multimodal retrieval (CMR) spanning diverse visual domains, and systematically evaluate common approaches within this setting. Our empirical analysis shows that standard CIL methods fail to yield meaningful gains in our more challenging scenario. Therefore, we propose Dynamic Adapter Routing (DAR), a novel approach based on adapters selected through prototype-based routing and combined via model merging.DAR achieves superior performance over the previous baselines and demonstrates strong generalization under out-of-distribution evaluation. Our results highlights the unique challenges of CMR and encourages further research in this direction.

持续学习多模态检索适配器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。