arXiv:2607.00529cs.CV2026-07中稿 · ECCV

用非参数分布提升3D场景图生成精度,同时保持实时推理。

NoPA: Non-Parametric Online 3D Scene Graph Generation

论文配图:NoPA: Non-Parametric Online 3D Scene Graph Generation
图 1 · 摘自论文原文
  • 用粒子集表示物体,替代单个高斯分布,保留更多几何细节。
  • 在KITTI和nuScenes上达到更高场景图准确率,且推理速度实时。
  • 适合需要高精度3D理解的自动驾驶与机器人系统使用。

传统3D场景图生成方法因环境映射计算开销大且需生成中间点云表示,难以实现实时运行。近期工作改用每个物体的轻量级高斯分布近似,显著加速推理并实现实时生成。但该方法存在两大缺陷:(1)每个物体仅由单一3D高斯表示,严重丢失几何细节;(2)近似与真实几何间的偏差加剧在线推断中对象候选合并的错误。为此,本文提出NoPA,将每个物体表示为独立的非参数分布,在保留3D几何信息的同时维持参数化高斯方法的实时性。基于此新表示,设计定制化合并策略:利用核密度估计上的最大均值差异(MMD)实现鲁棒合并,同时控制额外计算开销。关键在于为每个物体维护固定数量的粒子集。此外,为修复误分类导致的关系损失,NoPA传播高亲和度物体间的关系。实验表明,NoPA显著优于现有方法,且不牺牲实时推理速度。

原文摘要 · Abstract (English)

Classic 3D scene graph generation approaches fail to work in real-time due to the heavy computational cost of environment mapping and the need to generate intermediate point-cloud representations. To alleviate this issue, a recent work eschews point clouds in favor of a lightweight Gaussian distribution for each object. This approximation drastically speeds up inference and enables real-time 3D scene graph generation. However, the representation has two key weaknesses. \textbf{1)} Each object is approximated by a single 3D Gaussian, which causes a severe loss of 3D geometric detail. \textbf{2)} The discrepancy between this approximation and the true object geometry exacerbates the inaccurate merging of object candidates during online inference. To address these issues, we propose \textbf{NoPA}, which represents each object as a separate non-parametric distribution. This formulation retains 3D geometric information while preserving real-time inference of the parametric Gaussian formulation. To build upon our novel object representation, we propose a tailored merging strategy to recover coherent object instances. Specifically, we leverage maximum mean discrepancy on kernel density estimates to enable robust merging of object candidates during online exploration while minimizing added computational complexity. The key is to maintain a fixed particle set per object. Furthermore, to rectify the relation loss caused by misclassified objects, NoPA propagates relationships between objects with high affinity. Experiments show that NoPA substantially outperforms current methods without sacrificing real-time inference speed.

3D场景图非参数建模实时推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。