arXiv:2605.10484cs.CVcs.RO2026-05被引 1

提出高效3D场景图对齐框架,支持开放世界下的物体匹配与定位。

OpenSGA: Efficient 3D Scene Graph Alignment in the Open World

论文配图:OpenSGA: Efficient 3D Scene Graph Alignment in the Open World
图 1 · 摘自论文原文
  • 融合视觉语言、文本与几何特征,结合空间上下文进行对齐
  • 在帧到扫描和子扫描对齐任务中均达最优,即使坐标差异大仍准确
  • 适用于机器人长期记忆与多智能体地图融合,适合复杂环境导航

场景图对齐通过建立两组部分重叠观测构建的3D场景图之间的物体对应关系,实现机器人重访时的高效场景理解与物体级重定位,以及多智能体间的全局地图融合。现有方法主要聚焦于子扫描到子扫描(S2S)对齐,依赖几何点云特征,而帧到扫描(F2S)对齐与开放集视觉-语言特征研究不足。此外,现有数据集规模小、物体种类少,制约系统训练与评估。本文提出统一高效的场景图对齐框架,通过融合视觉-语言、文本与几何特征及空间上下文预测物体对应关系。框架包含距离门控空间注意力编码器、基于最小成本流的分配器与全局场景嵌入生成器,可在大坐标偏差下实现精准对齐。我们进一步构建了大规模数据集ScanNet-SG,采用自动化标注流程生成超70万样本,涵盖来自ScanNet标签的509类与GPT-4o生成标签的超过3000类。实验表明,本方法在F2S与S2S任务上均优于现有方法。代码与数据集已公开:https://autonomousrobots.nl/paper_websites/opensga。

原文摘要 · Abstract (English)

Scene graph alignment establishes object correspondences between two 3D scene graphs constructed from partially overlapping observations. This enables efficient scene understanding and object-level relocalization when a robot revisits a place, as well as global map fusion across multiple agents. Such capabilities are essential for robots that require long-term memory for long-horizon tasks involving interactions with the environment. Existing approaches mainly focus on subscan-to-subscan (S2S) alignment and depend heavily on geometric point-cloud features, leaving frame-to-scan (F2S) alignment and open-set vision-language features underexplored. In addition, existing datasets for scene graph alignment remain small-scale with limited object diversity, constraining systematic training and evaluation. We present a unified and efficient scene graph alignment framework that predicts object correspondences by fusing vision-language, textual, and geometric features with spatial context. The framework comprises modules such as a distance-gated spatial attention encoder, a minimum-cost-flow-based allocator, and a global scene embedding generator to achieve accurate alignment even under large coordinate discrepancies. We further introduce ScanNet-SG, a large-scale dataset generated via an automated annotation pipeline with over 700k samples, covering 509 object categories from ScanNet labels and over 3k categories from GPT-4o-based tagging. Experiments show that our method achieves the best overall performance on both F2S and S2S tasks, substantially outperforming existing scene graph alignment methods. Our code and dataset are released at: https://autonomousrobots.nl/paper_websites/opensga.

3D对齐场景图机器人导航开放世界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。