用语义信息指导机器人探索,让导航更智能。
SGE: Semantically-Guided Exploration for Unstructured Environments via Image-Space Waypoint Sampling

- 在图像空间中结合语义分割选点,兼顾地形和目标物
- 实测覆盖率达92.3%,支持按任务偏好调整探索方向
- 适合矿区、校园等复杂非结构化环境的自主探索
本文提出语义引导探索(SGE)框架,将像素级语义分割融入基于采样的航点选择与滚动时域路径优化中。与传统几何方法不同,SGE在图像空间中使用语义感知效用函数评估候选探索目标,综合考虑地形可通行性、障碍物距离、兴趣物体及深度奖励。采样航点投影至3D后通过实时旅行商问题(TSP)排序,实现滚动时域目标选择。为应对真实导航不确定性,引入临时禁区机制处理导航失败,并采用基于图的重定位策略实现高效回溯。在标准仿真基准上,SGE在体积覆盖率上表现优于主流探索规划器,且实现纯几何方法无法达成的语义任务偏置。进一步在多个机器人平台于校园建筑及石灰岩、煤矿环境中进行实地验证,结果表明其跨平台、跨场景性能稳定可靠。
原文摘要 · Abstract (English)
This work introduces Semantically-Guided Exploration (SGE), a modular exploration framework for ground vehicles that integrates pixel-level semantic segmentation into sampling-based waypoint selection and receding-horizon route optimization. Unlike conventional geometric exploration methods, SGE evaluates candidate exploration goals directly in the image space using a semantic-aware utility function that accounts for terrain traversability, obstacle proximity, objects of interest, and depth-based exploration reward. Sampled waypoints are projected into 3D and ordered through a real-time Traveling Salesman Problem (TSP) formulation, enabling receding-horizon goal selection. To address real-world navigation uncertainty, the framework introduces mechanisms, including temporary taboo regions to handle navigation failures and a graph-based relocation strategy for efficient backtracking across explored areas. We evaluate SGE in standardized simulation benchmarks against state-of-the-art exploration planners and demonstrate competitive performance in volumetric coverage, while enabling semantic task biasing that cannot be achieved by purely geometric methods. The framework is further validated through real-world experiments using multiple robotic platforms in indoor campus buildings and in limestone and coal mines. Results show consistent performance and adaptability across platforms and domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。