提出轻量级网络,用局部时空卷积提升步态识别鲁棒性
Local Spatiotemporal Convolutional Network for Robust Gait Recognition
- 设计双分支结构,让2D卷积处理时空信息
- 通过分块空间池化降低维度,支持时序卷积运算
- 异构卷积核增强运动模式提取,适合低资源部署
步态识别作为有前景的生物特征技术,可通过独特行走模式非侵入式识别个体,具备远距离适用性和抗伪装能力。然而,视频数据复杂且受视角、着装、负重等外部因素干扰,难以捕捉连续帧中的内在运动特征。现有方法多依赖静态外观特征或复杂序列模型(如LSTM、3D卷积),计算开销大且训练繁琐。为此,本文提出局部时空卷积网络(LSTCN),一种结构简单但高效的双分支架构,使标准2D卷积网络具备提取时序信息的能力。具体地,引入全局双向空间池化(GBSP)机制,将空间特征分解为水平与垂直条带局部表示,降低步态张量维度,使时序维度可参与2D卷积操作。在此基础上,设计局部时空卷积(LSTC)层,联合处理时空维度,自适应学习条带状步态运动模式。进一步采用异构卷积核,分别关注时序、空间及联合时空域,丰富特征表达。
原文摘要 · Abstract (English)
Gait recognition, as a promising biometric technology, identifies individuals through their unique walking patterns and offers distinctive advantages including non-invasiveness, long-range applicability, and resistance to deliberate disguise. Despite these merits, capturing the intrinsic motion patterns concealed within consecutive video frames remains challenging due to the complexity of video data and the interference of external covariates such as viewpoint changes, clothing variations, and carrying conditions. Existing approaches predominantly rely on either static appearance features extracted from individual silhouette frames or employ complex sequential models (\eg, LSTM, 3D convolutions) that demand substantial computational resources and sophisticated training strategies. To address these limitations, we propose a Local Spatiotemporal Convolutional Network (LSTCN), a structurally simple yet highly effective dual-branch architecture that endows standard two-dimensional convolutional networks with the capacity to extract temporal information. Specifically, we introduce a Global Bidirectional Spatial Pooling (GBSP) mechanism that reduces the dimensionality of gait tensors by decomposing spatial features into horizontal and vertical strip-based local representations, enabling the temporal dimension to participate in standard 2D convolution operations. Building upon this, we design a Local Spatiotemporal Convolutional (LSTC) layer that jointly processes temporal and spatial dimensions, allowing the network to adaptively learn strip-based gait motion patterns. We further extend this formulation with asymmetric convolution kernels that independently attend to the temporal, spatial, and joint spatiotemporal domains, thereby enriching the extracted feature representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。