arXiv:2502.10983cs.RO2025-02ICRA被引 9

让家用四足机器人走路更安静,靠强化学习优化关节阻尼与脚步速度。

Learning Quiet Walking for a Small Home Robot

  • 通过强化学习动态调节关节阻尼,降低踩地速度以减少噪音。
  • 实测显示新策略比基线和商用控制器安静30%以上。
  • 适合关注家庭人机共处体验的机器人研发者。

随着家用机器人逐渐普及,四足机器人(尤其类狗型)成为传统宠物的替代选择。然而用户反馈指出其行走时脚部撞击地面的声音过大。为此,本文提出一种基于仿真到现实的强化学习方法,旨在最小化与脚步声强相关的脚接触速度。框架包含三个关键部分:学习动态调节各关节的PD增益以主动阻尼或增强刚性、利用脚底接触传感器获取反馈、采用课程学习逐步加强脚接触速度惩罚。实验表明,所学策略在静音表现上优于强化学习基线及索尼商用控制器。同时揭示了静音性与鲁棒性之间的权衡关系。该研究推动了家庭环境中更安静、更友好的机器人伴侣发展。

原文摘要 · Abstract (English)

As home robotics gains traction, robots are increasingly integrated into households, offering companionship and assistance. Quadruped robots, particularly those resembling dogs, have emerged as popular alternatives for traditional pets. However, user feedback highlights concerns about the noise these robots generate during walking at home, particularly the loud footstep sound. To address this issue, we propose a sim-to-real based reinforcement learning (RL) approach to minimize the foot contact velocity highly related to the footstep sound. Our framework incorporates three key elements: learning varying PD gains to actively dampen and stiffen each joint, utilizing foot contact sensors, and employing curriculum learning to gradually enforce penalties on foot contact velocity. Experiments demonstrate that our learned policy achieves superior quietness compared to a RL baseline and the carefully handcrafted Sony commercial controllers. Furthermore, the trade-off between robustness and quietness is shown. This research contributes to developing quieter and more user-friendly robotic companions in home environments.

四足机器人强化学习降噪控制人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。