arXiv:2504.07598cs.CV2025-04AAAI被引 1

首次研究骨架自监督步态识别的规模效应,揭示数据与算力提升可显著增益性能。

On Model and Data Scaling for Skeleton-based Self-Supervised Gait Recognition

  • 基于270万条野外步行序列预训练Transformer模型,系统评估数据、模型规模与算力影响。
  • 发现性能随规模增长呈幂律提升,数据量和算力是决定下游识别准确率的关键因素。
  • 适合关注步态识别系统资源优化与性能预测的研究者与工程团队参考。

基于视频流的步态识别在计算机视觉生物特征识别中极具挑战性,源于步态间差异细微且受多种混淆因素影响。近年来自监督预训练推动了对行走协变量不变的鲁棒步态识别模型发展。尽管神经尺度定律已在其他领域通过关联性能与数据、模型规模及计算量改变模型研发范式,其在步态识别中的适用性尚无探索。本文首次对基于骨架的自监督步态识别开展实证规模研究,量化数据量、模型规模与计算量对下游步态识别性能的影响。我们在270万条野外采集的行走序列上预训练多个变体的GaitPT(一种基于Transformer的架构),并在四个基准数据集上评估零样本性能,推导出数据、模型规模与计算的尺度定律。结果表明,性能随规模增加呈现可预测的幂律提升,证实数据与计算量扩展显著影响下游准确率。通过在受控计算预算下对比GaitPT与GaitFormer,进一步分离出架构贡献。研究为真实世界步态识别系统的资源分配与性能预估提供了实用洞见。

原文摘要 · Abstract (English)

Gait recognition from video streams is a challenging problem in computer vision biometrics due to the subtle differences between gaits and numerous confounding factors. Recent advancements in self-supervised pretraining have led to the development of robust gait recognition models that are invariant to walking covariates. While neural scaling laws have transformed model development in other domains by linking performance to data, model size, and compute, their applicability to gait remains unexplored. In this work, we conduct the first empirical study scaling on skeleton-based self-supervised gait recognition to quantify the effect of data quantity, model size and compute on downstream gait recognition performance. We pretrain multiple variants of GaitPT - a transformer-based architecture - on a dataset of 2.7 million walking sequences collected in the wild. We evaluate zero-shot performance across four benchmark datasets to derive scaling laws for data, model size, and compute. Our findings demonstrate predictable power-law improvements in performance with increased scale and confirm that data and compute scaling significantly influence downstream accuracy. We further isolate architectural contributions by comparing GaitPT with GaitFormer under controlled compute budgets. These results provide practical insights into resource allocation and performance estimation for real-world gait recognition systems.

步态识别自监督学习模型缩放骨架分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。