arXiv:2606.11880cs.CV2026-06

用3D场景图实现轻量级序列视觉定位,省存储还准。

SG2Loc: Sequential Visual Localization on 3D Scene Graphs

论文配图:SG2Loc: Sequential Visual Localization on 3D Scene Graphs
图 1 · 摘自论文原文
  • 用物体+空间关系构建紧凑3D场景图,替代海量点云
  • 基于粒子滤波,通过语义特征匹配优化相机位姿
  • 适合资源受限的机器人/AR场景,支持实时更新

复杂室内环境中的视觉定位仍是机器人与AR应用的关键挑战。序列化定位通过时间累积提升姿态精度,但传统方法需存储大量图像或点云,开销大。本文提出一种轻量级序列视觉定位新方法——SG2Loc,利用3D场景图表示环境:节点为带粗略网格的物体,边编码空间关系。定位时,对每张图像提取局部语义特征并预测物体身份。在粒子滤波框架中,每个粒子(代表相机位姿)将场景图中的粗网格投影到图像,根据可见性为像素块分配物体身份。输入图像的局部特征与场景图中物体特征的相似性决定粒子权重。后续图像依次融入,逐步优化位姿估计。该方法通过紧凑场景图和高效语义匹配,在保持真实数据集性能的同时显著降低存储需求。代码将于https://github.com/DmblnNicole/sg2loc公开。

原文摘要 · Abstract (English)

Visual localization in complex indoor environments remains a critical challenge for robotics and AR applications. Sequential localization, where pose estimates are refined over time, is important for autonomous agents. However, traditional methods often require storing extensive image databases or point clouds, leading to significant overhead. This paper introduces a novel, lightweight approach to sequential visual localization using 3D scene graphs. Our method represents the environment with a compact scene graph, where nodes represent objects (with coarse meshes) and edges encode spatial relationships. For each image in the localization phase, we extract per-patch semantic features, predicting object identities. Localization is performed within a particle filter framework. Each particle, representing a camera pose, projects the coarse object meshes from the scene graph into the image, assigning object identities to patches based on visibility. The similarity of the per-patch features, in the input image, and object features from the scene graph determines the weight of a particle. Subsequent images are incorporated sequentially, refining the pose estimate. By leveraging a compact scene graph and efficient semantic matching, our method significantly reduces storage while maintaining performance on real-world datasets. The code will be available at https://github.com/DmblnNicole/sg2loc.

视觉定位3D场景图轻量级粒子滤波

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。