用模仿学习复现真实运动,可精准推断关节力矩与肌肉激活。
KinTwin: Imitation Learning with Torque and Muscle Driven Biomechanical Models Enables Precise Replication of Able-Bodied and Impaired Movement from Markerless Motion Capture
- 基于肌驱动生物力学模型,通过模仿学习还原运动轨迹。
- 在正常与受损人群动作上实现高精度追踪,包括辅助设备使用场景。
- 可临床级分析关节力矩与肌肉活动差异,适合康复研究应用。
更广泛地获取高质量运动分析数据,将极大促进运动科学与康复医学发展,例如更细致刻画运动障碍特征、评估干预效果,甚至实现神经疾病或跌倒风险的早期预警。尽管新兴技术使基于生物力学模型的运动学(如关节角度变化)采集变得容易,但推断支撑这些运动的底层物理机制(如地面反作用力、关节力矩、肌肉激活)仍具挑战。本文探索是否可通过模仿学习,在包含健全与受损个体的大规模运动数据集上,训练生物力学模型以求解逆动力学问题。与近年来在人体姿态估计中流行的模仿学习不同,本工作采用高精度生物力学模型而非计算机视觉模型,测试数据涵盖运动障碍者,报告了临床相关的追踪指标,如关节角度与足地接触事件,并首次将模仿学习应用于肌驱动的神经肌肉骨骼模型。结果表明,所提出的模仿学习策略KinTwin能准确复现多种运动模式,包括使用辅助装置或治疗师协助的情况,并能推断出具有临床意义的关节力矩与肌肉激活差异。该研究展示了模仿学习在临床运动分析中的潜力。
原文摘要 · Abstract (English)
Broader access to high-quality movement analysis could greatly benefit movement science and rehabilitation, such as allowing more detailed characterization of movement impairments and responses to interventions, or even enabling early detection of new neurological conditions or fall risk. While emerging technologies are making it easier to capture kinematics with biomechanical models, or how joint angles change over time, inferring the underlying physics that give rise to these movements, including ground reaction forces, joint torques, or even muscle activations, is still challenging. Here we explore whether imitation learning applied to a biomechanical model from a large dataset of movements from able-bodied and impaired individuals can learn to compute these inverse dynamics. Although imitation learning in human pose estimation has seen great interest in recent years, our work differences in several ways: we focus on using an accurate biomechanical model instead of models adopted for computer vision, we test it on a dataset that contains participants with impaired movements, we reported detailed tracking metrics relevant for the clinical measurement of movement including joint angles and ground contact events, and finally we apply imitation learning to a muscle-driven neuromusculoskeletal model. We show that our imitation learning policy, KinTwin, can accurately replicate the kinematics of a wide range of movements, including those with assistive devices or therapist assistance, and that it can infer clinically meaningful differences in joint torques and muscle activations. Our work demonstrates the potential for using imitation learning to enable high-quality movement analysis in clinical practice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。