无需源数据,用低秩专家融合实现高效多源域适应的人重识别
Low-Rank Expert Merging for Multi-Source Domain Adaptation in Person Re-Identification
- 为每个源域训练独立的低秩适配器,通过轻量门控网络动态融合
- 在Market-1501等3个基准上超越现有方法,参数量仅增加≤2%
- 适合资源受限场景,尤其适用于无法获取源域数据的部署环境
将人重识别模型适配至新目标环境仍是挑战性问题,通常通过无监督域适应(UDA)解决。当标签数据来自多个不同源(如不同数据集和摄像头)时,分别处理各源并采用多源域适应(MSDA)比合并源数据进行传统UDA更具准确性和鲁棒性。然而,现有最优MSDA方法需学习特定域的骨干网络或依赖源域数据,导致训练参数和计算成本显著增加。本文提出一种无源自适应门控专家(SAGE-reID)方法,实现低成本、无源的MSDA。首先通过无源UDA训练各源域专属的低秩适配器(LoRA),再引入轻量门控网络,动态分配最佳融合权重以实现跨域知识迁移。骨干参数数量保持不变,而LoRA专家规模线性增长但极小(≤骨干参数的2%),显著降低内存开销与过拟合风险。在Market-1501、DukeMTMC-reID和MSMT17三个挑战性基准上的大量实验表明,SAGE-reID在性能上优于现有方法,同时具备高计算效率。
原文摘要 · Abstract (English)
Adapting person re-identification (reID) models to new target environments remains a challenging problem that is typically addressed using unsupervised domain adaptation (UDA) methods. Recent works show that when labeled data originates from several distinct sources (e.g., datasets and cameras), considering each source separately and applying multi-source domain adaptation (MSDA) typically yields higher accuracy and robustness compared to blending the sources and performing conventional UDA. However, state-of-the-art MSDA methods learn domain-specific backbone models or require access to source domain data during adaptation, resulting in significant growth in training parameters and computational cost. In this paper, a Source-free Adaptive Gated Experts (SAGE-reID) method is introduced for person reID. Our SAGE-reID is a cost-effective, source-free MSDA method that first trains individual source-specific low-rank adapters (LoRA) through source-free UDA. Next, a lightweight gating network is introduced and trained to dynamically assign optimal merging weights for fusion of LoRA experts, enabling effective cross-domain knowledge transfer. While the number of backbone parameters remains constant across source domains, LoRA experts scale linearly but remain negligible in size (<= 2% of the backbone), reducing both the memory consumption and risk of overfitting. Extensive experiments conducted on three challenging benchmarks: Market-1501, DukeMTMC-reID, and MSMT17 indicate that SAGE-reID outperforms state-of-the-art methods while being computationally efficient.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。