用强化学习控制外骨骼,帮人蹲下时省力10%。
Reinforcement-Learning-Based Assistance Reduces Squat Effort with a Modular Hip--Knee Exoskeleton
- 用强化学习训练神经网络控制器,实时生成髋膝关节助力扭矩。
- 相比无助力和零力矩状态,代谢率降低约10%,心率轻微下降。
- 适合需要重复蹲起作业的工业场景,如装配线工人。
蹲起是下肢最费力的动作之一,需要大量肌肉用力与协调。通过智能个性化辅助降低该动作的体力负担,在重复性低姿装配等工业场景中具有重要意义。本研究评估了一种基于神经网络的模块化髋膝外骨骼控制器在协助蹲起任务中的效果。控制器通过物理仿真环境中的强化学习(RL)训练,根据近期关节角度与速度历史实时生成髋膝助力扭矩。五名健康成年人在三种条件下完成三分钟节拍引导蹲起:(1) 无外骨骼(No-Exo),(2) 外骨骼零力矩(Zero-Torque),(3) 外骨骼主动辅助(Assistance)。通过间接测热法和心率监测评估生理负荷,同时采集同步运动学数据。结果表明,基于强化学习的控制器能适应个体差异,生成匹配各受试者运动特征的力矩曲线。相比零力矩和无外骨骼条件,主动辅助使净代谢率降低约10%,心率略有下降。但辅助状态下蹲起深度减小,表现为髋膝屈曲角度更小。初步结果显示,该控制器可有效降低重复蹲起时的生理负荷,为硬件设计与控制策略优化提供依据。
原文摘要 · Abstract (English)
Squatting is one of the most demanding lower-limb movements, requiring substantial muscular effort and coordination. Reducing the physical demands of this task through intelligent and personalized assistance has significant implications, particularly in industries involving repetitive low-level assembly activities. In this study, we evaluated the effectiveness of a neural network controller for a modular Hip-Knee exoskeleton designed to assist squatting tasks. The neural network controller was trained via reinforcement learning (RL) in a physics-based, human-exoskeleton interaction simulation environment. The controller generated real-time hip and knee assistance torques based on recent joint-angle and velocity histories. Five healthy adults performed three-minute metronome-guided squats under three conditions: (1) no exoskeleton (No-Exo), (2) exoskeleton with Zero-Torque, and (3) exoskeleton with active assistance (Assistance). Physiological effort was assessed using indirect calorimetry and heart rate monitoring, alongside concurrent kinematic data collection. Results show that the RL-based controller adapts to individuals by producing torque profiles tailored to each subject's kinematics and timing. Compared with the Zero-Torque and No-Exo condition, active assistance reduced the net metabolic rate by approximately 10%, with minor reductions observed in heart rate. However, assisted trials also exhibited reduced squat depth, reflected by smaller hip and knee flexion. These preliminary findings suggest that the proposed controller can effectively lower physiological effort during repetitive squatting, motivating further improvements in both hardware design and control strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。