用图文联合生成难样本,提升换装行人重识别效果
Try Harder: Hard Sample Generation and Learning for Clothes-Changing Person Re-ID
- 通过图文双模态合成粗细粒度难样本,增强训练数据难度与多样性
- 引入硬度感知优化策略,加速收敛并实现当前最好性能
- 适合关注换装场景下模型鲁棒性的研究者与工程师
换装行人重识别(CC-ReID)中的难样本因外观相似性与定义模糊而成为关键瓶颈,制约学习策略设计并降低模型鲁棒性。本文提出首个统一文本与视觉模态的难样本生成与学习框架HSGL,包含两个核心组件:(1) 双粒度难样本生成(DGHSG),利用多模态线索合成语义一致的粗细粒度难正负样本,有效提升训练数据的复杂度与多样性;(2) 难样本自适应学习(HSAL),基于文本语义标签调整特征距离,促使难正样本分离、难负样本靠近,增强模型判别能力与抗干扰性。在多个CC-ReID基准测试中验证了方法有效性,尤其在PRCC与LTCC数据集上达到最先进性能,且显著加速目标学习过程。代码已开源。
原文摘要 · Abstract (English)
Hard samples pose a significant challenge in person re-identification (ReID) tasks, particularly in clothing-changing person Re-ID (CC-ReID). Their inherent ambiguity or similarity, coupled with the lack of explicit definitions, makes them a fundamental bottleneck. These issues not only limit the design of targeted learning strategies but also diminish the model's robustness under clothing or viewpoint changes. In this paper, we propose a novel multimodal-guided Hard Sample Generation and Learning (HSGL) framework, which is the first effort to unify textual and visual modalities to explicitly define, generate, and optimize hard samples within a unified paradigm. HSGL comprises two core components: (1) Dual-Granularity Hard Sample Generation (DGHSG), which leverages multimodal cues to synthesize semantically consistent samples, including both coarse- and fine-grained hard positives and negatives for effectively increasing the hardness and diversity of the training data. (2) Hard Sample Adaptive Learning (HSAL), which introduces a hardness-aware optimization strategy that adjusts feature distances based on textual semantic labels, encouraging the separation of hard positives and drawing hard negatives closer in the embedding space to enhance the model's discriminative capability and robustness to hard samples. Extensive experiments on multiple CC-ReID benchmarks demonstrate the effectiveness of our approach and highlight the potential of multimodal-guided hard sample generation and learning for robust CC-ReID. Notably, HSAL significantly accelerates the convergence of the targeted learning procedure and achieves state-of-the-art performance on both PRCC and LTCC datasets. The code is available at https://github.com/undooo/TryHarder-ACMMM25.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。