构建可模拟人体运动的多感官-肌肉骨骼模型,实现自然动作仿真。
Human sensory-musculoskeletal modeling and control of whole-body movements
- 整合解剖结构与视觉、前庭等多模态感知信息,构建全身运动模型。
- 通过分阶段深度强化学习框架,成功模拟步行、抓物和骑车三类动作。
- 揭示了无法直接测量的肌骨动态,适用于人机交互研究。
人体协调运动依赖于多感官输入、感觉运动转换、运动执行以及身体与环境互动带来的感觉反馈。构建精确的感官-肌肉骨骼系统动态模型,对于理解运动控制和探究人类行为至关重要。本文提出一种名为SMS-Human的人体感官-肌肉骨骼模型,该模型融合了骨骼、关节及肌腱单元的精确解剖表示,并集成视觉、前庭、本体感觉和触觉等多种感官输入。针对肌肉骨骼系统高维控制中的固有挑战,我们开发了一种分阶段的层次化深度强化学习框架。利用该框架,我们成功模拟了三种典型运动任务:双足行走、视觉引导的物体操作以及骑行中的人机交互。结果表明,仿真运动行为与自然人类行为高度相似,且揭示了难以直接测量的肌骨动力学特征。本研究深化了对人类运动感觉运动机制的理解,推动了在交互场景下人类行为的定量分析,并为具身智能系统的研发提供支持。
原文摘要 · Abstract (English)
Coordinated human movement depends on the integration of multisensory inputs, sensorimotor transformation, and motor execution, as well as sensory feedback resulting from body-environment interaction. Building dynamic models of the sensory-musculoskeletal system is essential for understanding movement control and investigating human behaviours. Here, we report a human sensory-musculoskeletal model, termed SMS-Human, that integrates precise anatomical representations of bones, joints, and muscle-tendon units with multimodal sensory inputs involving visual, vestibular, proprioceptive, and tactile components. A stage-wise hierarchical deep reinforcement learning framework was developed to address the inherent challenges of high-dimensional control in musculoskeletal systems with integrated multisensory information. Using this framework, we demonstrated the simulation of three representative movement tasks, including bipedal locomotion, vision-guided object manipulation, and human-machine interaction during bicycling. Our results showed a close resemblance between natural and simulated human motor behaviours. The simulation also revealed musculoskeletal dynamics that could not be directly measured. This work sheds deeper insights into the sensorimotor dynamics of human movements, facilitates quantitative understanding of human behaviours in interactive contexts, and informs the design of systems with embodied intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。