arXiv:2411.01639cs.ROcs.AI2024-11被引 15

提出分离感知与决策不确定性的框架,提升机器人规划可靠性。

Know Where You're Uncertain When Planning with Multimodal Foundation Models: A Formal Framework

  • 分离感知与决策两类不确定性,分别用校准与形式化方法量化
  • 实测任务成功率提升5%,结果变异性降低40%
  • 适合关注机器人可靠性与自主系统鲁棒性的研究者

多模态基础模型通过处理感官输入生成可执行计划,在机器人感知与规划中展现出巨大潜力。然而,确保任务可靠性仍面临感知(感官解读)与决策(计划生成)双重不确定性难题。本文提出一套完整框架,用于解耦、量化并缓解这两类不确定性。首先构建不确定性解耦框架,将感知不确定性(源于视觉理解局限)与决策不确定性(计划鲁棒性相关)分离。为量化每类不确定性,采用置信区间校准感知不确定性,并引入形式化驱动预测(FMDP),利用形式验证技术提供理论保证。基于量化结果,实施两种干预机制:主动感知策略动态重观测高不确定性场景以提升视觉质量,以及基于高置信度数据的自动化模型微调,增强模型满足任务规范的能力。在真实与仿真机器人任务中的实证验证表明,该框架使结果变异性降低40%,任务成功率提升5%。两项干预措施协同作用显著提升了自主系统的鲁棒性与可靠性。代码、数据集及微调模型已公开于 https://uncertainty-in-planning.github.io/。

原文摘要 · Abstract (English)

Multimodal foundation models offer a promising framework for robotic perception and planning by processing sensory inputs to generate actionable plans. However, addressing uncertainty in both perception (sensory interpretation) and decision-making (plan generation) remains a critical challenge for ensuring task reliability. We present a comprehensive framework to disentangle, quantify, and mitigate these two forms of uncertainty. We first introduce a framework for uncertainty disentanglement, isolating perception uncertainty arising from limitations in visual understanding and decision uncertainty relating to the robustness of generated plans. To quantify each type of uncertainty, we propose methods tailored to the unique properties of perception and decision-making: we use conformal prediction to calibrate perception uncertainty and introduce Formal-Methods-Driven Prediction (FMDP) to quantify decision uncertainty, leveraging formal verification techniques for theoretical guarantees. Building on this quantification, we implement two targeted intervention mechanisms: an active sensing process that dynamically re-observes high-uncertainty scenes to enhance visual input quality and an automated refinement procedure that fine-tunes the model on high-certainty data, improving its capability to meet task specifications. Empirical validation in real-world and simulated robotic tasks demonstrates that our uncertainty disentanglement framework reduces variability by up to 40% and enhances task success rates by 5% compared to baselines. These improvements are attributed to the combined effect of both interventions and highlight the importance of uncertainty disentanglement, which facilitates targeted interventions that enhance the robustness and reliability of autonomous systems. Fine-tuned models, code, and datasets are available at https://uncertainty-in-planning.github.io/.

机器人不确定性规划多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。