用生成模型增强步态识别,让特征更鲁棒。
Gait Recognition via Collaborating Discriminative and Generative Diffusion Models
- 融合生成与判别模型,分层控制身份与视觉细节
- 在4个数据集上达最新效果,提升现有方法性能
- 适合做步态识别或生成模型应用的开发者
步态识别通过行走姿态实现非接触式生物特征识别。尽管判别模型已取得显著成果,生成模型的潜力仍待挖掘。本文提出CoD²框架,结合扩散模型对数据分布的建模能力与判别模型的语义表征优势,提取鲁棒步态特征。设计多层级条件控制策略,融合高层身份感知语义条件与低层视觉细节。高层条件由判别提取器生成,引导生成一致身份的步态序列;低层外观与运动细节得以保留以增强一致性。生成序列反向促进判别提取器学习,使其捕捉更全面的高层语义特征。在SUSTech1K、CCPG、GREW和Gait3D四个数据集上的大量实验表明,CoD²达到当前最优性能,且可无缝集成至现有判别方法中,持续提升效果。
原文摘要 · Abstract (English)
Gait recognition offers a non-intrusive biometric solution by identifying individuals through their walking patterns. Although discriminative models have achieved notable success in this domain, the full potential of generative models remains largely underexplored. In this paper, we introduce \textbf{CoD$^2$}, a novel framework that combines the data distribution modeling capabilities of diffusion models with the semantic representation learning strengths of discriminative models to extract robust gait features. We propose a Multi-level Conditional Control strategy that incorporates both high-level identity-aware semantic conditions and low-level visual details. Specifically, the high-level condition, extracted by the discriminative extractor, guides the generation of identity-consistent gait sequences, whereas low-level visual details, such as appearance and motion, are preserved to enhance consistency. Furthermore, the generated sequences facilitate the discriminative extractor's learning, enabling it to capture more comprehensive high-level semantic features. Extensive experiments on four datasets (SUSTech1K, CCPG, GREW, and Gait3D) demonstrate that CoD$^2$ achieves state-of-the-art performance and can be seamlessly integrated with existing discriminative methods, yielding consistent improvements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。