arXiv:2606.25119cs.RO2026-06中稿 · ICRA

融合机器人与监控系统,实现多视角协同寻物导航

SurveilNav: Collaborative Object Goal Navigation with Robot and Surveillance System

论文配图:SurveilNav: Collaborative Object Goal Navigation with Robot and Surveillance System
图 1 · 摘自论文原文
  • 用动态摄像头调度+2D/3D联合建图提升感知能力
  • 在HM3D上探索效率和成功率均达当前最佳
  • 适合大型场所搜索、家庭服务与救援场景

随着监控系统在工厂、办公室和家庭中的广泛应用,将其与机器人结合为协同高效任务执行提供了新方向。然而,现有方法多集中于单机器人场景,在大规模环境中的多视角协作方面存在不足。本文基于Habitat-Sim构建了一个新型室内协同目标导航数据集,包含74层楼的206个摄像头,可系统评估智能体利用多视角监控信息的能力。为解决单机器人感知受限问题,提出SurveilNav框架,整合主动摄像头调度、联合2D/3D建图、基于视觉语言模型的价值估计与协同目标验证。该架构通过结合机器人动态局部感知与监控系统静态全局视图,有效克服了单智能体感知范围有限及固定摄像头盲区问题,显著提升探索效率。在HM3D数据集上的实验表明,SurveilNav在探索效率与导航成功率上均显著优于现有方法,达到当前最优水平。系统在大规模搜寻、家庭环境及救援任务中展现出强应用潜力。

原文摘要 · Abstract (English)

With the growing deployment of surveillance systems in factories, offices, and homes, integrating them with robots offers a promising direction for collaborative and efficient task execution. However, existing approaches largely focus on single-robot scenarios and struggle with multi-view collaboration in large-scale environments. In this paper, we present a novel indoor collaborative object navigation dataset built on Habitat-Sim, featuring 206 cameras across 74 floors. The dataset enables systematic evaluation of an agent's ability to exploit multi-view surveillance information. To address the limitations of single-robot perception, we propose SurveilNav, a collaborative navigation framework that integrates active camera scheduling, joint 2D/3D mapping, VLM-based value estimation, and collaborative target verification. By synergizing the robot's dynamic local perception with the static global view of surveillance, this architecture effectively overcomes both the limited perception range of single agents and the inherent blind spots of fixed cameras, resolving inefficient exploration. Experimental results on the HM3D dataset demonstrate that SurveilNav substantially outperforms existing methods, achieving state-of-the-art performance in both exploration efficiency and navigation success rate. Moreover, the system shows strong potential for applications in large-scale search, home environments, and rescue missions.

协同导航监控融合目标寻物机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。