用仿真训练髋外骨骼控制策略,无需实测数据即可直接部署到硬件。
Learning Hip Exoskeleton Control Policy via Predictive Neuromusculoskeletal Simulation
- 基于肌肉协同的强化学习框架,在仿真中训练控制策略。
- 仿真中肌肉激活降低3.4%,关节正功率减少7.0%,速度越快效果越明显。
- 模拟到现实迁移成功,适合外骨骼研发与生物力学研究者参考。
开发能适应多种运动条件的外骨骼控制器通常需要大量动作捕捉数据和生物力学标注,限制了其在非受控实验室环境中的可扩展性。本文提出一种基于物理的神经肌肉学习框架,完全在仿真中训练髋外骨骼控制策略,无需动作捕捉示范,并通过策略蒸馏部署到硬件。采用两阶段课程学习,强化学习教师策略在多种行走速度和坡度下训练,使用肌肉协同动作先验,实现有无外骨骼条件的直接对比。仿真中,外骨骼辅助使平地和上坡时平均肌肉激活降低最多达3.4%,平均正关节功耗降低最多达7.0%,且效果随速度提升而增强。硬件测试显示,仿真中学习的辅助模式在匹配的速度-坡度条件下得以保留(相关系数r: 0.82,RMSE: 0.03 Nm/kg),为无需额外调参的模拟到现实迁移提供了量化证据。结果表明,基于物理的神经肌肉仿真可作为外骨骼控制器开发的实用且可扩展基础,显著降低设计阶段的实验负担。
原文摘要 · Abstract (English)
Developing exoskeleton controllers that generalize across diverse locomotor conditions typically requires extensive motion-capture data and biomechanical labeling, limiting scalability beyond instrumented laboratory settings. Here, we present a physics-based neuromusculoskeletal learning framework that trains a hip-exoskeleton control policy entirely in simulation, without motion-capture demonstrations, and deploys it on hardware via policy distillation. A reinforcement learning teacher policy is trained using a muscle-synergy action prior over a wide range of walking speeds and slopes through a two-stage curriculum, enabling direct comparison between assisted and no-exoskeleton conditions. In simulation, exoskeleton assistance reduces mean muscle activation by up to 3.4% and mean positive joint power by up to 7.0% on level ground and ramp ascent, with benefits increasing systematically with walking speed. On hardware, the assistance profiles learned in simulation are preserved across matched speed-slope conditions (r: 0.82, RMSE: 0.03 Nm/kg), providing quantitative evidence of sim-to-real transfer without additional hardware tuning. These results demonstrate that physics-based neuromusculoskeletal simulation can serve as a practical and scalable foundation for exoskeleton controller development, substantially reducing experimental burden during the design phase.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。