arXiv:2511.14533cs.AI2025-11被引 1

让机器人在模糊感知下可靠决策,从视觉到动作全程考虑不确定性。

A Neuro-Symbolic Framework for Reasoning under Perceptual Uncertainty: Bridging Continuous Perception and Discrete Symbolic Planning

  • 用神经网络提取视觉中的概率符号状态,再用符号规划器动态应对不确定
  • 在3个机器人任务中平均成功率90.7%,比最强基线高10-14个百分点
  • 适合需要感知-决策联动的智能系统,如自动驾驶、服务机器人

将连续感知信号与离散符号推理相结合是人工智能系统在不确定性环境下运行的核心挑战。本文提出一种神经符号框架,显式建模并传播从感知到规划的不确定性,为这两个抽象层次提供原则性连接。该方法结合基于Transformer的感知前端与图神经网络(GNN)关系推理,从视觉观测中提取带有校准置信度的概率符号状态(整体F1=0.68),并采用不确定性感知的符号规划器,在置信度低时主动收集信息。在桌面上机器人操作任务中验证:翻译器处理10,047个PyBullet生成场景(3-10个物体),输出概率谓词;嵌入规划器后,系统在Simple Stack、Deep Stack和Clear+Stack基准上分别达到94%/90%/88%的成功率(平均90.7%),优于最强的POMDP基线10-14个百分点,且规划耗时仅15毫秒。通过概率图模型分析,建立了校准不确定性与规划收敛之间的定量联系,提供了可验证的理论保证。该框架通用性强,适用于任何需从感知输入到符号规划进行不确定性感知推理的领域。

原文摘要 · Abstract (English)

Bridging continuous perceptual signals and discrete symbolic reasoning is a fundamental challenge in AI systems that must operate under uncertainty. We present a neuro-symbolic framework that explicitly models and propagates uncertainty from perception to planning, providing a principled connection between these two abstraction levels. Our approach couples a transformer-based perceptual front-end with graph neural network (GNN) relational reasoning to extract probabilistic symbolic states from visual observations, and an uncertainty-aware symbolic planner that actively gathers information when confidence is low. We demonstrate the framework's effectiveness on tabletop robotic manipulation as a concrete application: the translator processes 10,047 PyBullet-generated scenes (3--10 objects) and outputs probabilistic predicates with calibrated confidences (overall F1=0.68). When embedded in the planner, the system achieves 94\%/90\%/88\% success on Simple Stack, Deep Stack, and Clear+Stack benchmarks (90.7\% average), exceeding the strongest POMDP baseline by 10--14 points while planning within 15\,ms. A probabilistic graphical-model analysis establishes a quantitative link between calibrated uncertainty and planning convergence, providing theoretical guarantees that are validated empirically. The framework is general-purpose and can be applied to any domain requiring uncertainty-aware reasoning from perceptual input to symbolic planning.

神经符号不确定性机器人推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。