让机器人在杂物中精准走路,避免踩到电线等敏感物
Watch Your Step: Learning Semantically-Guided Locomotion in Cluttered Environment
- 用两阶段强化学习融合语义与几何信息判断脚落点
- 在真实复杂环境里碰撞率大幅降低,能避开细小危险物
- 适合需要高精度行走的工业巡检、服务机器人场景
尽管足式机器人在崎岖地形上表现出色,但在杂乱环境中安全使用仍具挑战。主要问题在于其无法避免踩踏低矮物体,如平地上的高价值设备或电缆。这一局限源于高层语义理解与底层控制之间的脱节,以及实际运行中高程地图的误差。为此,我们提出SemLoco,一种基于强化学习的框架,可在密集杂乱环境中精确避障。SemLoco采用两阶段强化学习,结合软约束与硬约束,进行像素级足位安全性推理,实现更精准的落脚。同时,它集成语义地图,可为不同区域分配可通行成本,而非仅依赖几何数据。实验表明,SemLoco显著减少碰撞,提升对敏感物体的避让能力,实现在传统控制器易造成损坏的场景下可靠导航。结果还显示,该方法可有效应用于更复杂、非结构化的现实环境。演示视频见:https://youtu.be/FSq-RSmIxOM。
原文摘要 · Abstract (English)
Although legged robots demonstrate impressive mobility on rough terrain, using them safely in cluttered environments remains a challenge. A key issue is their inability to avoid stepping on low-lying objects, such as high-cost small devices or cables on flat ground. This limitation arises from a disconnection between high-level semantic understanding and low-level control, combined with errors in elevation maps during real-world operation. To address this, we introduce SemLoco, a Reinforcement Learning (RL) framework designed to avoid obstacles precisely in densely cluttered environments. SemLoco uses a two-stage RL approach that combines both soft and hard constraints. It performs pixel-wise foothold safety inference, which enables more accurate foot placement. Additionally, SemLoco integrates semantic map, allowing it to assign traversability costs instead of relying only on geometric data. SemLoco greatly reduces collisions and improves safety around sensitive objects, enabling reliable navigation in situations where traditional controllers would likely cause damage. Experimental results further show that SemLoco can be effectively applied to more complex, unstructured real-world environments. A demo video can be view at https://youtu.be/FSq-RSmIxOM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。