用预训练扩散模型提升跨域行人重识别的泛化能力。
Unleashing the Potential of Pre-Trained Diffusion Models for Generalizable Person Re-Identification
- 将判别式重识别模型与预训练扩散模型结合,通过关联感知条件注入暗知识。
- 在单源和多源场景下均达到当前最优性能,显著提升跨域泛化效果。
- 适合关注跨域行人重识别与生成式模型融合的研究者参考。
领域泛化行人重识别(DG Re-ID)旨在使用一个或多个源域训练模型,并在未见的目标域上评估性能,因其实际应用价值而受到越来越多关注。尽管已有多种方法被提出,但多数依赖判别或对比学习框架来学习通用特征表示,常因无法缓解捷径学习而导致性能不佳。本文提出一种新方法:扩散模型辅助的表征学习与相关性感知条件机制(DCAC),将判别式与对比式重识别模型与预训练扩散模型通过相关性感知条件机制相结合。通过将重识别模型生成的身份分类概率与可学习的身份提示词结合,该机制注入捕捉身份关联的暗知识以指导扩散过程。同时,扩散模型的反馈经由条件机制反向传播至重识别模型,有效提升了重识别特征的泛化能力。在单源与多源DG Re-ID任务上的大量实验表明,本方法实现当前最优性能。全面的消融实验进一步验证了方法的有效性与鲁棒性。代码将发布于 https://github.com/RikoLi/DCAC。
原文摘要 · Abstract (English)
Domain-generalizable re-identification (DG Re-ID) aims to train a model on one or more source domains and evaluate its performance on unseen target domains, a task that has attracted growing attention due to its practical relevance. While numerous methods have been proposed, most rely on discriminative or contrastive learning frameworks to learn generalizable feature representations. However, these approaches often fail to mitigate shortcut learning, leading to suboptimal performance. In this work, we propose a novel method called diffusion model-assisted representation learning with a correlation-aware conditioning scheme (DCAC) to enhance DG Re-ID. Our method integrates a discriminative and contrastive Re-ID model with a pre-trained diffusion model through a correlation-aware conditioning scheme. By incorporating ID classification probabilities generated from the Re-ID model with a set of learnable ID-wise prompts, the conditioning scheme injects dark knowledge that captures ID correlations to guide the diffusion process. Simultaneously, feedback from the diffusion model is back-propagated through the conditioning scheme to the Re-ID model, effectively improving the generalization capability of Re-ID features. Extensive experiments on both single-source and multi-source DG Re-ID tasks demonstrate that our method achieves state-of-the-art performance. Comprehensive ablation studies further validate the effectiveness of the proposed approach, providing insights into its robustness. Codes will be available at https://github.com/RikoLi/DCAC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。