arXiv:2505.18582cs.CVcs.AI2025-05CVPR被引 21

用扩散模型去除视频中衣服等干扰,提升步态识别准确率

On Denoising Walking Videos for Gait Recognition

  • 基于扩散模型和人体结构先验,自动过滤无关视觉信息
  • 在三个数据集上达到当前最优性能,跨域识别效果显著
  • 适合做步态识别、生物特征识别研究者参考

为捕捉个体步态特征,排除服装纹理、颜色等与身份无关的干扰因素,仍是视觉步态识别的持续挑战。传统基于轮廓和姿态的方法虽理论上可去除干扰,但因输入稀疏且信息量不足,常难以达到高精度。新兴端到端方法通过人体先验直接对RGB视频进行去噪。本文提出DenoisingGait,受‘我无法创造的,我不理解’启发,采用生成式扩散模型,揭示其在步态理解中部分滤除无关因素的机制。此外,引入几何驱动的特征匹配模块,结合人体轮廓背景去除,将每个前景像素的多通道扩散特征压缩为二维方向向量。该方法分别实现帧内与跨帧匹配,捕获步态外观与运动的局部向量化结构,生成新型流式步态表征——步态特征场,进一步降低扩散特征中的残余噪声。在CCPG、CASIA-B*和SUSTech1K数据集上的实验表明,DenoisingGait在多数情况下于域内与跨域评估中均达到新最先进水平。代码已开源:https://github.com/ShiqiYu/OpenGait。

原文摘要 · Abstract (English)

To capture individual gait patterns, excluding identity-irrelevant cues in walking videos, such as clothing texture and color, remains a persistent challenge for vision-based gait recognition. Traditional silhouette- and pose-based methods, though theoretically effective at removing such distractions, often fall short of high accuracy due to their sparse and less informative inputs. Emerging end-to-end methods address this by directly denoising RGB videos using human priors. Building on this trend, we propose DenoisingGait, a novel gait denoising method. Inspired by the philosophy that "what I cannot create, I do not understand", we turn to generative diffusion models, uncovering how they partially filter out irrelevant factors for gait understanding. Additionally, we introduce a geometry-driven Feature Matching module, which, combined with background removal via human silhouettes, condenses the multi-channel diffusion features at each foreground pixel into a two-channel direction vector. Specifically, the proposed within- and cross-frame matching respectively capture the local vectorized structures of gait appearance and motion, producing a novel flow-like gait representation termed Gait Feature Field, which further reduces residual noise in diffusion features. Experiments on the CCPG, CASIA-B*, and SUSTech1K datasets demonstrate that DenoisingGait achieves a new SoTA performance in most cases for both within- and cross-domain evaluations. Code is available at https://github.com/ShiqiYu/OpenGait.

步态识别扩散模型视频去噪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。