让机器人通过解读路牌实现大型室内导航,无需地图也能成功到达目的地。
SignNav: Leveraging Signage for Semantic Visual Navigation in Large-Scale Indoor Environments
- 用时空感知模型理解路牌语义并结合历史状态做决策
- 在未见过的环境中达到80%成功率和0.74的NDTW
- 适合研究无地图环境下基于视觉与语义的智能导航
人类在医院、机场等大型室内环境中常依赖路牌提供的语义提示进行导航,但这一能力在具身导航领域尚未被充分探索。本文提出新任务SignNav,要求智能体解析路牌语义并基于当前观察推理下一步动作。为此构建了LSI-Dataset用于训练与评估。由于路牌语义动态变化且分布稀疏,挑战显著。为此提出时空感知变换器START模型:空间模块将路牌语义锚定到物理世界,时间模块捕捉历史状态与当前观测间的长程依赖。采用两阶段训练策略结合数据聚合(DAgger),方法在验证集未见场景中取得80%成功率(SR)和0.74的NDTW,真实环境部署证明其无需预建地图即可实用。
原文摘要 · Abstract (English)
Humans routinely leverage semantic hints provided by signage to navigate to destinations within novel Large-Scale Indoor (LSI) environments, such as hospitals and airport terminals. However, this capability remains underexplored within the field of embodied navigation. This paper introduces a novel embodied navigation task, SignNav, which requires the agent to interpret semantic hint from signage and reason about the subsequent action based on current observation. To facilitate research in this domain, we construct the LSI-Dataset for the training and evaluation of various SignNav agents. Dynamically changing semantic hints and sparse placement of signage in LSI environments present significant challenges to the SignNav task. To address these challenges, we propose the Spatial-Temporal Aware Transformer (START) model for end-to-end decision-making. The spatial-aware module grounds the semantic hint of signage into physical world, while the temporal-aware module captures long-range dependencies between historical states and current observation. Leveraging a two-stage training strategy with Dataset Aggregation (DAgger), our approach achieves state-of-the-art performance, recording an 80% Success Rate (SR) and 0.74 NDTW on val-unseen split. Real-world deployment further demonstrates the practicality of our method in physical environment without pre-built map.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。