用事件触发的双智能体强化学习,让康复机器人更智能地配合患者动作。
Dual-Agent Multiple-Model Reinforcement Learning for Event-Triggered Human-Robot Co-Adaptation in Decoupled Task Spaces
- 患者用二值指令选方向,机器人自动修正垂直方向,解耦控制任务
- 事件触发机制减少振荡,使抓取成功率提升,端点误差降低23%
- 适合康复训练场景,尤其对运动控制不稳定的患者有良好适应性
本文提出一种共享控制的康复策略,针对定制的6自由度上肢机器人,将复杂伸手任务分解为解耦的空间轴。患者通过二值指令控制主要运动方向,机器人自主调节正交方向的修正动作。传统固定频率控制因逆运动学执行时间变化常导致轨迹振荡,因此提出事件驱动的推进策略:仅当末端执行器进入以目标点为中心的准入球时才触发下一步控制。该架构在半虚拟环境中验证,结合物理压力传感器与MuJoCo仿真。为安全高效优化人-机共适应,引入双智能体多模型强化学习(DAMMRL)。该框架离散化决策特征:人类智能体选择准入球半径以反映其速度-精度权衡,机器人智能体动态调整三维笛卡尔步长以匹配用户认知状态。在仿真中训练并在混合环境中部署,该事件触发的DAMMRL方法有效抑制了路径点抖动,平衡空间精度与时间效率,显著提升物体抓取任务的成功率。
原文摘要 · Abstract (English)
This paper presents a shared-control rehabilitation policy for a custom 6-degree-of-freedom (6-DoF) upper-limb robot that decomposes complex reaching tasks into decoupled spatial axes. The patient governs the primary reaching direction using binary commands, while the robot autonomously manages orthogonal corrective motions. Because traditional fixed-frequency control often induces trajectory oscillations due to variable inverse-kinematics execution times, an event-driven progression strategy is proposed. This architecture triggers subsequent control actions only when the end-effector enters an admission sphere centred on the immediate target waypoint, and was validated in a semi-virtual setup linking a physical pressure sensor to a MuJoCo simulation. To optimise human--robot co-adaptation safely and efficiently, this study introduces Dual Agent Multiple Model Reinforcement Learning (DAMMRL). This framework discretises decision characteristics: the human agent selects the admission sphere radius to reflect their inherent speed--accuracy trade-off, while the robot agent dynamically adjusts its 3D Cartesian step magnitudes to complement the user's cognitive state. Trained in simulation and deployed across mixed environments, this event-triggered DAMMRL approach effectively suppresses waypoint chatter, balances spatial precision with temporal efficiency, and significantly improves success rates in object acquisition tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。