arXiv:2608.26739cs.ROcs.SY2026-08

用强化学习补偿机械臂控制误差,提升康复机器人抗扰能力。

Residual Deep Reinforcement Learning-Based Computed Torque Control for a Cable-Driven Lower-Limb Rehabilitation Robot under Disturbances and Parametric Uncertainties

论文配图:Residual Deep Reinforcement Learning-Based Computed Torque Control for a Cable-Driven Lower-Limb Rehabilitation Robot under Disturbances and Parametric Uncertainties
图 1 · 摘自论文原文
  • 在经典控制基础上添加有界强化学习补偿项,保持可解释性。
  • 仿真中跟踪误差降低30%以上,有效抑制干扰与参数不确定性。
  • 适合需要高可靠性和安全约束的康复机器人控制场景。

电缆驱动下肢康复机器人的精确轨迹跟踪面临模型不确定性、外部干扰、关节约束及仅拉力驱动电缆等挑战,导致传统模型控制性能下降。基于模型的控制器虽具可解释性,但对模型失配敏感;纯学习方法则降低透明度并复杂化约束处理。本文提出一种残差深度强化学习增强的计算力矩控制框架:计算力矩控制生成基础指令,有界深度确定性策略仅提供额外补偿扭矩。该方法在正常、不确定、干扰、混合及泛化条件下进行仿真评估,涵盖轨迹跟踪、关节限位、缆索需求、工作空间可行性及缆索雅可比诊断。结果表明,在所有测试条件下,残差控制器相比计算力矩控制显著提升跟踪精度与抗扰能力,同时保持模型基指令结构可解释性,并通过各项可行性验证。更广泛测试显示,跟踪改进可在代表性案例外持续存在,但也暴露出轨迹依赖的约束局限性。研究支持有界残差学习作为仿真康复机器人控制中实用的鲁棒性增强策略,并推动进一步的约束感知与实验验证。

原文摘要 · Abstract (English)

Accurate trajectory tracking in cable-driven lower-limb rehabilitation robots is challenging because model uncertainty, external disturbances, joint constraints, and pull-only cable actuation can degrade nominal control performance. Conventional model-based controllers provide an interpretable control structure but remain sensitive to model mismatch, whereas fully learning-based control can reduce transparency and complicate constraint-aware operation. This study proposes a residual deep reinforcement learning-enhanced computed torque control framework in which computed torque control generates the nominal command and a bounded Deep Deterministic Policy Gradient policy supplies only an additional compensating torque. The approach is evaluated in simulation under nominal, uncertain, disturbed, combined, and generalization conditions, together with trajectory-tracking, joint-limit, cable-demand, workspace-feasibility, and cable-Jacobian diagnostics. Across the evaluated conditions, the residual controller improves tracking and disturbance rejection relative to computed torque control while preserving the interpretable model-based command structure and satisfying the reported feasibility checks in the representative evaluation. Broader tests indicate that tracking improvements can persist beyond the representative case while also exposing trajectory-dependent constraint limitations. These results support bounded residual learning as a practical robustness-enhancement strategy for simulation-based rehabilitation robot control and motivate further constraint-aware and experimental validation.

康复机器人强化学习控制优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。