提出一种无需训练的不确定性感知融合框架,提升在线3D场景图生成稳定性。
PUF: Plug-and-Play Uncertainty-Aware Fusion for Online 3D Scene Graph Generation

- 将节点关联建模为概率似然,用狄利克雷证据积累处理多源不确定性
- 在3DSSG和ReplicaSSG上性能显著优于现有方法,保持实时推理速度
- 插件式设计适配多种3D表示,适合需要可靠增量建图的机器人应用
在线3D场景图生成通过逐步融合2D观测构建全局3D结构化表示。现有方法将其视为完全确定性流程,我们识别出三种被忽略的不确定性来源:观测、2D模型与3D表示。为此提出PUF:一种无需训练、即插即用且具备不确定性感知能力的融合框架。将场景图节点关联重新定义为语义与空间因素的概率似然,替代二元接受/拒绝门控机制。狄利克雷证据累积根据关联似然比例分配类别与关系证据至可能候选。可选的类别条件先验可补全稀疏或从未共观测对象对的边。我们在3D Gaussian与3D voxel两种后端上实现PUF,并观察到一致性能提升,证明其跨表示泛化能力。在3DSSG与ReplicaSSG基准上的实验表明,该方法显著优于现有方案,同时保持实时延迟。结果确立了不确定性感知融合作为在线3D场景理解的有效范式。代码已公开于https://github.com/yyyyangyi/PUF。
原文摘要 · Abstract (English)
Online 3D scene graph generation builds a persistent, structured representation of a scene by incrementally fusing 2D observations into a global 3D graph. Existing online methods treat this fusion as a fully deterministic pipeline, where we identify three sources of uncertainty that are overlooked: observation, 2D model, and 3D representation. We propose PUF: a Plug-and-play, Uncertainty-aware, and training-free Fusion framework. Scene graph node association is reformulated as a probabilistic likelihood over semantic and spatial factors, replacing binary accept/reject gates. Dirichlet evidence accumulation distributes class and relationship evidence across plausible candidates proportional to association likelihood. An optional class-conditional prior completes edges for sparsely or never co-observed object pairs. We instantiate PUF with both a 3D Gaussian and a 3D voxel backend and observe consistent improvements, demonstrating its ability to generalize across different representations. Experiments on the 3DSSG and ReplicaSSG benchmarks show that our method substantially outperforms existing approaches while maintaining real-time latency. These results establish uncertainty-aware fusion as a principled and effective paradigm for online 3D scene understanding. The source code is publicly available at https://github.com/yyyyangyi/PUF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。