用视频分析帕金森患者转身时的步数,无需穿戴设备。
Every Step of the Way: Video-based Parkinsonian Turning Step Counting

- 通过3D人体网格和光流融合捕捉步态运动特征
- 在真实帕金森数据集上误差低于现有方法
- 适合居家长期监测,无需佩戴传感器
帕金森病(PD)的典型症状之一是转身障碍,其严重程度可通过转身角度、持续时间及完成转身所需的步数来评估,其中步数直接反映运动功能障碍。由于真实场景中转身动作差异大,且帕金森步态常呈不规则拖行,准确计步极具挑战。现有方法多依赖可穿戴设备,需用户佩戴并管理,不便用于日常连续监测。为此,我们提出一种被动式视频分析框架,采用从粗到精的策略,结合多种运动表征进行步数估计。首先,基于3D人体网格恢复得到的足部运动信号生成初始步数估计,提供高层运动结构信息;随后,引入运动编码器,融合网格与光流信息,学习细粒度步态动态以优化初始结果。在此过程中,粗粒度足部信号通过交叉注意力机制查询像素级运动线索,捕捉细微的帕金森步态特征。为适应不同长度视频,将每段视频分割为片段,利用多实例学习(MIL)整合片段级运动嵌入,预测步数残差。大量实验表明,该方法在真实世界帕金森转身数据集上始终优于现有步数计数方法。
原文摘要 · Abstract (English)
As a prominent symptom of Parkinson's disease (PD), turning impairment is evaluated through parameters such as turning angle, duration, and particularly, the number of steps required to complete a turn, which directly reflects motor dysfunction. Accurate step counting is challenging due to variability in real-world turning movements and atypical shuffling patterns in parkinsonian gait. Existing methods are predominantly wearable-based, requiring users to wear and manage dedicated devices, which can be inconvenient for continuous daily use. To address this, we propose a passive, video-based framework that estimates step count in a coarse-to-fine manner using diverse motion representations. Specifically, an initial step count is estimated from foot movement signals derived from 3D human mesh recovery, providing high-level motion structures. To incorporate fine-grained motion details, a motion encoder learns complementary gait dynamics from mesh and optical flow to refine the initial estimate. In this process, coarse foot movement signals query the pixel-level motion cues via cross attention to capture subtle parkinsonian gait dynamics. To handle varying video lengths, we partition each video into clips and integrate clip-wise motion embeddings via multiple instance learning (MIL) for step count residual prediction. Extensive experiments show our method consistently outperforms existing step counting methods on real-world PD turning datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。