用普通摄像头分析3-17岁儿童走路姿态,助力发育障碍诊断
Decoding Children's Gait Behavior

- 基于60帧/秒视频与人体姿态数据,构建多视角儿童步态数据集
- 发现现有顶尖模型在识别细微运动异常时表现不佳,准确率低于60%
- 提出端到端框架,为儿科步态自动分析提供新基准和研究方向
我们引入一个全新的人体动作识别问题:从标准RGB视频中细粒度分析3至17岁儿童的步态行为。这些行为对脑瘫、偏瘫等发育及神经肌肉疾病诊断治疗具有重要临床价值。尽管如此,当前依赖3D传感器的步态分析系统成本高、侵入性强,难以用于年幼儿童。为此,我们构建了一个包含110名受试者、超过1,100段60帧/秒高帧率视频的新数据集,每段视频对应5秒“绕行行走”任务,覆盖多个视角,并配有同步匿名的姿态序列。关键发现是,当前最先进的步态基础模型和多模态大语言模型(MLLMs)无法有效捕捉这些细微且不规则的运动特征。我们识别出分析此类运动模式的核心技术挑战,并提出一个统一的端到端框架,用于解码儿童步态的基本构成。通过全面实验,验证了该数据集在推动新研究问题和建立自动化儿童步态评估基准方面的潜力。
原文摘要 · Abstract (English)
We introduce a new problem domain for human action recognition: the fine-grained analysis of children's gait behaviors from standard RGB video. We specifically target the ambulatory patterns of children aged 3-17 years. Such behaviors arise naturally in the diagnosis and treatment of several critical developmental and neuromuscular disorders, such as cerebral palsy and hemiplegia. Despite their clinical value, current 3D sensor-based gait analysis systems are expensive, intrusive, and often impractical for young subjects. To address this, we introduce a new dataset comprising over 1,100 high-frame-rate (60 FPS) video sequences from 110 subjects, accompanied by synchronized, anonymized pose sequences. In each session, the child performs a 5-second "walk-around" task, capturing the gait cycle from multiple viewpoints. Crucially, we demonstrate that current state-of-the-art approaches, including gait foundation models and Multimodal Large Language Models (MLLMs), fail to effectively resolve these clinical nuances. We identify the key technical challenges in analyzing these erratic and subtle motor patterns and describe a unified end-to-end framework for decoding fundamental components of pediatric gait. Through comprehensive experimental results, we demonstrate the potential of this dataset to drive novel research questions and establish a rigorous baseline for automated child gait assessment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。