让四足机器人在降噪与灵活移动间自由切换,适应不同环境需求。
QuietPaw: Learning Quadrupedal Locomotion with Versatile Noise Preference Alignment
- 通过条件噪声约束策略,让一个模型适应不同降噪等级。
- 仿真与真实场景均验证:噪声可连续调节,且运动性能不下降。
- 适合需安静运行的医疗、办公等场景中的机器人部署。
四足机器人在全速运行时会产生较大脚步噪音,在家庭、办公室和医院等人机共处环境中可能造成干扰。因此,如何在运动性能与噪声控制之间取得平衡,是实现四足机器人实际应用的关键。然而,实现自适应降噪面临三大挑战:(a)敏捷性与降噪之间的权衡;(b)在多种部署条件下保持泛化能力;(c)根据噪声需求动态调整策略。本文提出 QuietPaw 框架,引入条件噪声约束策略(CNCP),一种基于学习的约束算法,通过将噪声降低程度作为条件输入,实现灵活、噪声感知的运动控制。我们采用评论家中的值表示解耦机制,将状态表示与条件相关表示分离,使单一通用策略无需重训练即可跨不同噪声水平泛化,同时优化敏捷性与降噪之间的帕累托前沿。我们在仿真与真实世界中验证了该方法,结果表明 CNCP 能有效平衡运动性能与噪声约束,实现连续可调的降噪效果。
原文摘要 · Abstract (English)
When operating at their full capacity, quadrupedal robots can produce loud footstep noise, which can be disruptive in human-centered environments like homes, offices, and hospitals. As a result, balancing locomotion performance with noise constraints is crucial for the successful real-world deployment of quadrupedal robots. However, achieving adaptive noise control is challenging due to (a) the trade-off between agility and noise minimization, (b) the need for generalization across diverse deployment conditions, and (c) the difficulty of effectively adjusting policies based on noise requirements. We propose QuietPaw, a framework incorporating our Conditional Noise-Constrained Policy (CNCP), a constrained learning-based algorithm that enables flexible, noise-aware locomotion by conditioning policy behavior on noise-reduction levels. We leverage value representation decomposition in the critics, disentangling state representations from condition-dependent representations and this allows a single versatile policy to generalize across noise levels without retraining while improving the Pareto trade-off between agility and noise reduction. We validate our approach in simulation and the real world, demonstrating that CNCP can effectively balance locomotion performance and noise constraints, achieving continuously adjustable noise reduction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。