arXiv:2607.01044cs.RO2026-07中稿 · IEEE/RSJ Internati…

机器人通过提问找人,让导航更智能。

Robots Ask the Way: Communication-Enabled Social Navigation

论文配图:Robots Ask the Way: Communication-Enabled Social Navigation
图 1 · 摘自论文原文
  • 机器人主动向人询问目标位置,实现信息驱动导航。
  • 使用对话模块后任务成功率提升10个百分点。
  • 能理解口语化对话,适合真实家庭环境应用。

在多人环境中,辅助型自主机器人需高效定位特定人员。现有社交导航方法侧重避障与轨迹调整,缺乏通过人机通信主动获取信息的机制。本文提出通信增强型社交导航(CommNav),让机器人主动向居民询问目标人物的近期踪迹、位置和移动情况。为评估该任务,我们扩展Habitat 3.0,构建支持多人类交互与信息交换协议的Habitat 3.0c。将通信模块(COMM)集成至先进社交导航模型,使任务成功率达10个百分点提升。进一步研究从结构化数据到自然语言的转换,对比基于大模型生成指令与真人调研收集的口语指令。实验表明:(i) 明确的人机通信显著提升多人导航性能;(ii) 在通信预训练任务上微调COMM可有效应对偶发交互信号问题;(iii) 导航策略对自然口语高度鲁棒,其任务成功率与使用理想结构化数据的模型无统计差异。

原文摘要 · Abstract (English)

Assistive autonomous robots operating in multi-agent environments require efficient strategies to locate specific individuals among multiple residents. Current social navigation methods focus on reactive collision avoidance and trajectory adaptation, but lack mechanisms to proactively gather information through human-robot communication. We introduce Communication-enabled Social Navigation (CommNav). In this novel task, robotic agents actively seek assistance from residents to locate target individuals by requesting information about recent sightings, locations, and movements. To evaluate CommNav, we extend Habitat 3.0 to create Habitat 3.0c, a communication-enabled variant supporting multi-human environments with information exchange protocols. Adding our communication module (COMM) to a state-of-the-art social navigation model yields a 10 percentage-point improvement in Episode Success. We further investigate the transition from structured data to natural language by evaluating models trained on LLM-generated instructions and on colloquial instructions collected from a human study. Our experiments reveal that: (i) explicit human-robot communication substantially enhances multi-person navigation performance; (ii) pre-training COMM on a communication pretext task effectively addresses the challenge of occasional interaction signals; and (iii) the navigation policy is highly robust to natural, colloquial human language, achieving an episode success statistically similar to the model using perfect structured data.

人机交互社交导航自然语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。