arXiv:2512.00691cs.CV2025-12被引 2

首个可扩展的步态基础模型,实现跨任务、跨场景的高精度识别。

Silhouette-based Gait Foundation Model

  • 自监督预训练,基于12个公开数据集上200万条行走序列训练
  • 零样本下在Gait3D达48.0%准确率,OU-MVLP达64.5%
  • 支持身份识别、脊柱侧弯筛查等多任务,适配不同输入模态

步态模式在人体识别与健康分析中至关重要,但现有研究受限于小规模、专用模型,难以扩展和泛化。构建统一的步态基础模型需突破两大难题:(a)可扩展性——为何步态模型长期无法遵循缩放定律?(b)泛化能力——能否一个模型覆盖以往孤立研究的多样化任务?我们提出FoundationGait,首个可扩展的自监督步态理解预训练框架。其最大版本参数量近0.13亿,在包含超过200万条行走序列的12个公开步态数据集上预训练。大量实验表明,FoundationGait无论是否微调,均在多种步态数据集、环境、任务(如身份识别、脊柱侧弯筛查、抑郁预测、属性估计)及输入模态下表现稳健。尤其在具有挑战性的in-the-wild Gait3D数据集(1000名测试者)上实现48.0%零样本排名1准确率,在最大的in-the-lab OU-MVLP数据集(5000+测试者)上达64.5%,创下鲁棒步态识别新标杆。代码与模型已开源:https://github.com/ShiqiYu/OpenGait。

原文摘要 · Abstract (English)

Gait patterns play a critical role in human identification and healthcare analytics, yet current progress remains constrained by small, narrowly designed models that fail to scale or generalize. Building a unified gait foundation model requires addressing two longstanding barriers: (a) Scalability. Why have gait models historically failed to follow scaling laws? (b) Generalization. Can one model serve the diverse gait tasks that have traditionally been studied in isolation? We introduce FoundationGait, the first scalable, self-supervised pretraining framework for gait understanding. Its largest version has nearly 0.13 billion parameters and is pretrained on 12 public gait datasets comprising over 2 million walking sequences. Extensive experiments demonstrate that FoundationGait, with or without fine-tuning, performs robustly across a wide spectrum of gait datasets, conditions, tasks (e.g., human identification, scoliosis screening, depression prediction, and attribute estimation), and even input modality. Notably, it achieves 48.0% zero-shot rank-1 accuracy on the challenging in-the-wild Gait3D dataset (1,000 test subjects) and 64.5% on the largest in-the-lab OU-MVLP dataset (5,000+ test subjects), setting a new milestone in robust gait recognition. Coming code and model: https://github.com/ShiqiYu/OpenGait.

步态识别基础模型自监督学习健康分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。