用强化学习让机器人适应有肌肉骨骼损伤史的工人,提升安全性和工作效率。
A Human-Sensitive Controller: Adapting to Human Musculoskeletal Disorder-Related Constraints via Reinforcement Learning
- 通过强化学习动态调整机器人控制策略,匹配个体身体特征。
- DQN算法使任务完成时间平均缩短38%,且零疼痛风险。
- 适合康复后重返职场或需人机协作的工业场景。
工作相关肌肉骨骼疾病仍是工业环境中的重大挑战,导致劳动力参与度下降、医疗成本上升及长期残疾。本研究提出一种以人为本的机器人系统,旨在帮助有肌肉骨骼疾病史的个体重新胜任标准工作,同时优化整体工作场所的人体工程学条件。研究采用强化学习(RL)开发人机协同机器人的自适应控制策略,重点优化任务执行时的舒适度与疼痛预防。比较了Q-Learning与深度Q网络(DQN)两种方法,并根据个体特征进行个性化控制。尽管存在仿真到现实的差距,但经过微调后策略成功适配真实环境。DQN在所有测试人体参数下均表现更优,任务完成时间平均缩短38%,且保持零疼痛风险和安全的人体工程学水平。结构化测试验证了系统对多样化人体数据的适应能力,表明基于强化学习的协作机器人有望实现更安全、更具包容性的工作环境。
原文摘要 · Abstract (English)
Work-Related Musculoskeletal Disorders continue to be a major challenge in industrial environments, leading to reduced workforce participation, increased healthcare costs, and long-term disability. This study introduces a human-sensitive robotic system aimed at reintegrating individuals with a history of musculoskeletal disorders into standard job roles, while simultaneously optimizing ergonomic conditions for the broader workforce. This research leverages reinforcement learning (RL) to develop a human-aware control strategy for collaborative robots, focusing on optimizing ergonomic conditions and preventing pain during task execution. Two RL approaches, Q-Learning and Deep Q-Network (DQN), were implemented and tested to personalize control strategies based on individual user characteristics. Although experimental results revealed a simulation-to-real gap, a fine-tuning phase successfully adapted the policies to real-world conditions. DQN outperformed Q-Learning by completing tasks faster while maintaining zero pain risk and safe ergonomic levels, achieving on average 38% shorter task completion times across all tested anthropometries. The structured testing protocol confirmed the system's adaptability to diverse human anthropometries, underscoring the potential of RL-driven cobots to enable safer, more inclusive workplaces.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。