构建分层语义图,让机器人在未知环境自主巡检更智能
An Actionable Hierarchical Scene Representation Enhancing Autonomous Inspection Missions in Unknown Environments
- 用多层抽象的语义图表示场景,结合规划器实现分层决策
- 实测在城市户外环境中成功延长巡检任务,提升环境感知能力
- 适合需要自主探索的机器人巡检、灾害排查等场景
本文提出分层语义图(LSG),一种与多模态任务规划器FLIE(基于首次观察的巡检与探索规划器)深度集成的可操作分层场景图。该方法旨在维护直观且多分辨率的场景表示,同时为未知目标的巡检任务提供可计算的规划与理解基础。LSG由多层嵌套的层级图构成,抽象概念与集成的FLIE规划器功能对齐,并嵌入实时语义分割模型,实现对特定语义元素的提取与定位。这使规划器能依据语义图作出精准巡检决策。实验在仿真和真实场景中验证:基于波士顿动力Spot四足机器人,在城市户外环境中部署,证明了该架构的有效性。
原文摘要 · Abstract (English)
In this article, we present the Layered Semantic Graphs (LSG), a novel actionable hierarchical scene graph, fully integrated with a multi-modal mission planner, the FLIE: A First-Look based Inspection and Exploration planner. The novelty of this work stems from aiming to address the task of maintaining an intuitive and multi-resolution scene representation, while simultaneously offering a tractable foundation for planning and scene understanding during an ongoing inspection mission of apriori unknown targets-of-interest in an unknown environment. The proposed LSG scheme is composed of locally nested hierarchical graphs, at multiple layers of abstraction, with the abstract concepts grounded on the functionality of the integrated FLIE planner. Furthermore, LSG encapsulates real-time semantic segmentation models that offer extraction and localization of desired semantic elements within the hierarchical representation. This extends the capability of the inspection planner, which can then leverage LSG to make an informed decision to inspect a particular semantic of interest. We also emphasize the hierarchical and semantic path-planning capabilities of LSG, which could extend inspection missions by improving situational awareness for human operators in an unknown environment. The validity of the proposed scheme is proven through extensive evaluations of the proposed architecture in simulations, as well as experimental field deployments on a Boston Dynamics Spot quadruped robot in urban outdoor environment settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。