arXiv:2603.07629cs.ROcs.LG2026-03被引 2

用强化学习训练外骨骼,让人体关节受力更小,仿真结果可验证。

Exoskeleton Control through Learning to Reduce Biological Joint Moments in Simulations

  • 通过强化学习优化外骨骼助力策略,减少人体真实关节受力。
  • 仿真控制器在平地与上坡行走中,髋关节力矩预测相关性高达0.98。
  • 适合做仿生外骨骼控制研究的团队参考,尤其关注仿真到现实的迁移。

数据驱动的关节力矩预测为生物力学估计和外骨骼控制提供了可扩展的替代方案,而基于物理的强化学习(RL)使仿真训练的控制器能够在无需大量人体实验的情况下,学习动态感知的辅助策略。然而,对仿真训练的外骨骼扭矩预测器及其对人体关节功率注入的影响,仍缺乏定量验证。本文提出:(1)一种通过强化学习学习减少生物关节力矩的外骨骼辅助策略框架;(2)一个利用开源步态数据集进行推理与生物关节力矩对比的验证流程。针对平地与爬坡行走,开发了基于多层感知机(MLP)的控制器,将双侧髋膝运动学的短时序历史映射为归一化助力扭矩。结果显示,预测助力能保持不同速度与坡度下的任务强度趋势。髋关节表现尤为出色,1.8米/秒时相关系数达0.94,5°下坡时达0.98,时间结构高度匹配。但在高速与陡坡下,膝关节差异增大,关节功率比较中偏差更明显。延迟调优使助力偏向正功率注入;适度的时间偏移可提升正功率并改善特定步态阶段的一致性。这些结果建立了一个量化验证框架,证明了控制器在扭矩层面的强仿真-数据一致性,同时揭示了仿真到现实迁移中的潜力与挑战。

原文摘要 · Abstract (English)

Data-driven joint-moment predictors offer a scalable alternative to laboratory-based inverse-dynamics pipelines for biomechanics estimation and exoskeleton control. Meanwhile, physics-based reinforcement learning (RL) enables simulation-trained controllers to learn dynamics-aware assistance strategies without extensive human experimentation. However, quantitative verification of simulation-trained exoskeleton torque predictors, and their impact on human joint power injection, remains limited. This paper presents (1) an RL framework to learn exoskeleton assistance policies that reduce biological joint moments, and (2) a validation pipeline that verifies the trained control networks using an open-source gait dataset through inference and comparison with biological joint moments. Simulation-trained multilayer perceptron (MLP) controllers are developed for level-ground and ramp walking, mapping short-horizon histories of bilateral hip and knee kinematics to normalized assistance torques. Results show that predicted assistance preserves task-intensity trends across speeds and inclines. Agreement is particularly strong at the hip, with cross-correlation coefficients reaching 0.94 at 1.8 m/s and 0.98 during 5° decline walking, demonstrating near-matched temporal structure. Discrepancies increase at higher speeds and steeper inclines, especially at the knee, and are more pronounced in joint power comparisons. Delay tuning biases assistance toward greater positive power injection; modest timing shifts increase positive power and improve agreement in specific gait intervals. Together, these results establish a quantitative validation framework for simulation-trained exoskeleton controllers, demonstrate strong sim-to-data consistency at the torque level, and highlight both the promise and the remaining challenges for sim-to-real transfer.

外骨骼控制强化学习关节力矩仿真验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。