用多重未来想象提升机器人在未知环境中的导航安全与发现能力
Schrödinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation
- 推理时构建多条路径对应的3D未来场景,保持多种可能状态
- 在遮挡密集场景中,隐藏目标发现率显著提升,风险路径选择更优
- 适合真实复杂环境中无需微调的零样本导航任务
零样本物体导航(ZSON)要求机器人在未见过的环境中定位目标物体,无需特定任务微调或预建地图,是通用服务机器人的关键能力。然而,仿真中表现良好的方法在真实世界杂乱场景中常因严重遮挡和潜在危险而性能下降,大范围未知区域使单一场景推断变得脆弱且不安全。我们提出Schrödinger's Navigator,一种信念感知框架,在推理时基于候选路径生成多个轨迹条件化的3D未来想象。通过轨迹条件化的3D世界模型预测假设观测,并维护多个合理场景实现的叠加态,而非确定单一地图。自适应遮挡感知采样器引导想象力聚焦于不确定性关键区域,而未来感知价值图(FAVM)聚合想象中的未来状态,实现鲁棒且前瞻性的动作选择。仿真与物理Go2四足机器人实验表明,该方法优于强基线,显著提升遮挡密集场景下隐藏目标的发现率与风险感知的路径规划能力。结果表明,3D未来想象是一种可扩展、通用的零样本导航策略,适用于不确定的真实环境。
原文摘要 · Abstract (English)
Zero-shot object navigation (ZSON) requires robots to find target objects in unseen environments without task-specific fine-tuning or pre-built maps, a key capability for general-purpose service robots. Yet methods that perform well in simulation often degrade in cluttered real-world scenes with severe occlusion and latent hazards, where large unseen regions make single-scene inference brittle and unsafe. We propose Schrödinger's Navigator, a belief-aware framework that reasons at inference time over multiple trajectory-conditioned imagined 3D futures. Given candidate paths, a trajectory-conditioned 3D world model predicts hypothetical observations and maintains a superposition of plausible scene realizations rather than committing to one map. An adaptive occluder-aware sampler directs imagination to uncertainty-critical regions, while a Future-Aware Value Map (FAVM) aggregates imagined futures for robust, proactive action selection. Experiments in simulation and on a physical Go2 quadruped show that Schrödinger's Navigator outperforms strong ZSON baselines, improving hidden-target discovery and risk-aware waypoint selection in occlusion-heavy navigation scenarios. These results highlight imagined 3D futures as a scalable and generalizable strategy for zero-shot navigation in uncertain real-world environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。