让视觉导航在数据少时仍能稳健决策,提升跨环境泛化能力。
Seeing through Uncertainty: Robust Task-Oriented Optimization in Visual Navigation
- 用校准的分段凸神经网络将模糊视觉预测转为可优化的不确定集
- 在部分可观测场景下重构为鲁棒优化问题,实现不确定性感知决策
- 在未见过环境中表现最优,适合需要高泛化性的智能体部署
视觉导航是具身人工智能的基础问题,但实际应用需长程规划以应对多目标任务。主要瓶颈在于数据稀缺:从有限数据中学习的策略常过拟合,难以泛化至分布外(OOD)场景。现有基于神经网络的智能体通常增加模型复杂度,反而在小样本情形下适得其反。本文提出NeuRO,一个将感知网络与下游任务级鲁棒优化紧密结合的学习-优化框架。具体而言,NeuRO解决核心挑战:(i) 利用部分输入凸神经网络(PICNNs)结合共形校准,将数据稀缺下的噪声视觉预测转化为凸不确定集,直接参数化优化约束;(ii) 将部分可观测环境中的规划重构为鲁棒优化问题,生成具备不确定性感知能力的策略,支持跨环境迁移。在无序与序列多目标导航任务上的大量实验表明,NeuRO在未见环境中显著优于现有方法,建立新基准。本工作为开发鲁棒、可泛化的自主智能体提供了重要进展。
原文摘要 · Abstract (English)
Visual navigation is a fundamental problem in embodied AI, yet practical deployments demand long-horizon planning capabilities to address multi-objective tasks. A major bottleneck is data scarcity: policies learned from limited data often overfit and fail to generalize OOD. Existing neural network-based agents typically increase architectural complexity that paradoxically become counterproductive in the small-sample regime. This paper introduce NeuRO, a integrated learning-to-optimize framework that tightly couples perception networks with downstream task-level robust optimization. Specifically, NeuRO addresses core difficulties in this integration: (i) it transforms noisy visual predictions under data scarcity into convex uncertainty sets using Partially Input Convex Neural Networks (PICNNs) with conformal calibration, which directly parameterize the optimization constraints; and (ii) it reformulates planning under partial observability as a robust optimization problem, enabling uncertainty-aware policies that transfer across environments. Extensive experiments on both unordered and sequential multi-object navigation tasks demonstrate that NeuRO establishes SoTA performance, particularly in generalization to unseen environments. Our work thus presents a significant advancement for developing robust, generalizable autonomous agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。