用单摄像头视频精准分析步态,适合临床快速评估。
Quantitative Gait Analysis from Single RGB Videos Using a Dual-Input Transformer-Based Network
- 双输入变换器网络融合视觉与时空特征,提升估计精度。
- 在运动障碍患者数据集上,步态偏差指数等指标误差低于10%。
- 仅需普通摄像头,适合基层医院或远程医疗场景。
步态与运动分析已成为诊断健康问题、监测疾病进展及评估治疗、手术和康复干预效果的重要临床工具。然而,定量运动评估仍受限于昂贵的运动捕捉系统和专业人员,难以普及。近年来,深度神经网络的发展使得仅用单摄像头视频实现定量运动分析成为可能,为传统运动捕捉提供了可及性更高的替代方案。本文提出一种基于双输入卷积变换器网络的高效临床步态分析方法,通过单视角摄像头采集的RGB视频,准确估计关键步态参数,包括步态偏差指数(GDI)、膝关节屈曲角度、步长和步行频率。该方法在运动障碍患者数据集上验证,表现优于现有最先进方法,在资源消耗更少的前提下展现出高精度与鲁棒性,尤其适用于资源有限的临床环境。
原文摘要 · Abstract (English)
Gait and movement analysis have become a well-established clinical tool for diagnosing health conditions, monitoring disease progression for a wide spectrum of diseases, and to implement and assess treatment, surgery and or rehabilitation interventions. However, quantitative motion assessment remains limited to costly motion capture systems and specialized personnel, restricting its accessibility and broader application. Recent advancements in deep neural networks have enabled quantitative movement analysis using single-camera videos, offering an accessible alternative to conventional motion capture systems. In this paper, we present an efficient approach for clinical gait analysis through a dual-pattern input convolutional Transformer network. The proposed system leverages a dual-input Transformer model to estimate essential gait parameters from single RGB videos captured by a single-view camera. The system demonstrates high accuracy in estimating critical metrics such as the gait deviation index (GDI), knee flexion angle, step length, and walking cadence, validated on a dataset of individuals with movement disorders. Notably, our approach surpasses state-of-the-art methods in various scenarios, using fewer resources and proving highly suitable for clinical application, particularly in resource-constrained environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。