arXiv:2412.11495cs.CV2024-12AAAI被引 34

对比三种步态表征,提出新融合方法提升远距离行人识别性能

Exploring More from Multiple Gait Modalities for Human Identification

  • 从轮廓、人体分割到光流,系统比较三类步态表征
  • 在多个数据集上验证新融合策略,最高提升1.8%识别率
  • 适合关注步态识别与多模态特征融合的研究者

步态作为一种非接触式生物特征,能反映个体远距离行走的独特模式,具有广阔的应用前景。尽管轮廓和骨骼长期以来是主流的步态表征方式,近年来研究尝试引入人体分割图和光流图像等更丰富的数据形式,并采用多分支网络结构。然而,由于模型设计和实验设置不一致,目前仍缺乏对这些主流步态模态在表征能力与融合策略上的全面公平比较。本文从细粒度形状与粗粒度形状、整体运动与像素级运动建模两个角度,深入分析轮廓、人体分割和光流三种常见表征,揭示其异同。基于发现,提出C²Fusion融合策略,构建MultiGait++框架,通过保留共性、突出差异来增强步态特征学习。在Gait3D、GREW、CCPG和SUSTech1K四个数据集上进行了大量实验验证,代码已开源。

原文摘要 · Abstract (English)

The gait, as a kind of soft biometric characteristic, can reflect the distinct walking patterns of individuals at a distance, exhibiting a promising technique for unrestrained human identification. With largely excluding gait-unrelated cues hidden in RGB videos, the silhouette and skeleton, though visually compact, have acted as two of the most prevailing gait modalities for a long time. Recently, several attempts have been made to introduce more informative data forms like human parsing and optical flow images to capture gait characteristics, along with multi-branch architectures. However, due to the inconsistency within model designs and experiment settings, we argue that a comprehensive and fair comparative study among these popular gait modalities, involving the representational capacity and fusion strategy exploration, is still lacking. From the perspectives of fine vs. coarse-grained shape and whole vs. pixel-wise motion modeling, this work presents an in-depth investigation of three popular gait representations, i.e., silhouette, human parsing, and optical flow, with various fusion evaluations, and experimentally exposes their similarities and differences. Based on the obtained insights, we further develop a C$^2$Fusion strategy, consequently building our new framework MultiGait++. C$^2$Fusion preserves commonalities while highlighting differences to enrich the learning of gait features. To verify our findings and conclusions, extensive experiments on Gait3D, GREW, CCPG, and SUSTech1K are conducted. The code is available at https://github.com/ShiqiYu/OpenGait.

步态识别多模态融合特征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。