用SetTransformer实现无需训练的跨数据集步态注册,解决新身份识别难题。
Database-Agnostic Gait Enrollment using SetTransformers
- 基于集合变换器,仅凭样本与库集嵌入做注册决策。
- 在CASIA-B和PsyMo上准确率超传统方法,且不依赖阈值调参。
- 适用于不同数据集、人数和步数场景,适合真实监控部署。
步态识别已成为无感远距离身份分析的强大工具,在监控与安防中日益重要。尽管深度学习和大规模数据集使闭集识别精度大幅提升,但实际应用需开放集步态注册——判断新样本是否属于已知身份或为全新个体。本文提出一种基于Transformer的开放集步态注册框架,具备数据集无关与识别架构无关特性。该方法利用SetTransformer,基于查询样本嵌入与画廊上下文集嵌入进行注册决策,无需任务特定阈值或环境重训练。通过将注册与主识别流程解耦,模型可泛化于不同数据集、画廊规模及身份分布。我们设计了基于现有数据集不同身份与步数比例的评估协议,采用骨架表示,并在两个基准数据集(CASIA-B、PsyMo)上,使用三种先进模型(GaitGraph、GaitFormer、GaitPT)的嵌入进行验证。结果表明,本方法灵活、多场景准确,且在数据增长时表现更优。代码与数据场景将公开。
原文摘要 · Abstract (English)
Gait recognition has emerged as a powerful tool for unobtrusive and long-range identity analysis, with growing relevance in surveillance and monitoring applications. Although recent advances in deep learning and large-scale datasets have enabled highly accurate recognition under closed-set conditions, real-world deployment demands open-set gait enrollment, which means determining whether a new gait sample corresponds to a known identity or represents a previously unseen individual. In this work, we introduce a transformer-based framework for open-set gait enrollment that is both dataset-agnostic and recognition-architecture-agnostic. Our method leverages a SetTransformer to make enrollment decisions based on the embedding of a probe sample and a context set drawn from the gallery, without requiring task-specific thresholds or retraining for new environments. By decoupling enrollment from the main recognition pipeline, our model is generalized across different datasets, gallery sizes, and identity distributions. We propose an evaluation protocol that uses existing datasets in different ratios of identities and walks per identity. We instantiate our method using skeleton-based gait representations and evaluate it on two benchmark datasets (CASIA-B and PsyMo), using embeddings from three state-of-the-art recognition models (GaitGraph, GaitFormer, and GaitPT). We show that our method is flexible, is able to accurately perform enrollment in different scenarios, and scales better with data compared to traditional approaches. We will make the code and dataset scenarios publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。