通过几何变换建模步态差异,实现跨视角跨服饰的步态识别
Learning Geometric Invariance for Gait Recognition
- 将步态变化视为反射、旋转、缩放三种几何变换的组合
- 在四个数据集上优于现有方法,跨视角识别准确率提升显著
- 适合关注步态识别泛化能力的研究者和应用开发者
步态识别旨在提取个体在不同步态条件下的身份不变特征,例如跨视角和跨着装。现有模型多通过数据驱动方式隐式学习不同条件下的共性特征以拉近识别距离。但较少研究显式探索不同步态条件间的内在关系。本文提出新视角:不同步态条件的变化可近似视为几何变换的组合。由此只需确定变换类型并实现几何不变性,身份不变性自然成立。作为初步尝试,我们研究了反射、旋转、缩放三种常见几何变换,设计了$$\mathcal{R}$eflect-$$\mathcal{R}$otate-$$\mathcal{S}$cale不变性学习框架${\mathcal{RRS}}$-Gait。具体而言,该框架首先根据特定几何变换灵活调整卷积核,实现近似特征等变;随后将三类等变特征分别输入全局池化层,完成最终的不变性学习。在四个主流步态数据集(Gait3D、GREW、CCPG、SUSTech1K)上的大量实验表明,该方法在多种步态条件下均表现优异。
原文摘要 · Abstract (English)
The goal of gait recognition is to extract identity-invariant features of an individual under various gait conditions, e.g., cross-view and cross-clothing. Most gait models strive to implicitly learn the common traits across different gait conditions in a data-driven manner to pull different gait conditions closer for recognition. However, relatively few studies have explicitly explored the inherent relations between different gait conditions. For this purpose, we attempt to establish connections among different gait conditions and propose a new perspective to achieve gait recognition: variations in different gait conditions can be approximately viewed as a combination of geometric transformations. In this case, all we need is to determine the types of geometric transformations and achieve geometric invariance, then identity invariance naturally follows. As an initial attempt, we explore three common geometric transformations (i.e., Reflect, Rotate, and Scale) and design a $\mathcal{R}$eflect-$\mathcal{R}$otate-$\mathcal{S}$cale invariance learning framework, named ${\mathcal{RRS}}$-Gait. Specifically, it first flexibly adjusts the convolution kernel based on the specific geometric transformations to achieve approximate feature equivariance. Then these three equivariant-aware features are respectively fed into a global pooling operation for final invariance-aware learning. Extensive experiments on four popular gait datasets (Gait3D, GREW, CCPG, SUSTech1K) show superior performance across various gait conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。