arXiv:2503.01783cs.ROcs.CV2025-03被引 6

将视觉SLAM与3D场景图结合,让地图更懂语义、更好理解。

vS-Graphs: Tightly Coupling Visual SLAM and 3D Scene Graphs Exploiting Hierarchical Scene Understanding

  • 基于视觉识别房间与楼层结构,构建可优化的3D场景图
  • 在多个数据集上平均定位精度提升15.22%
  • 仅用摄像头实现接近激光雷达的语义识别效果

当前视觉同时定位与地图构建(VSLAM)系统难以生成语义丰富且易读的地图。尽管引入语义信息有助于建立带上下文关联的更丰富地图,但将其以结构化形式(如场景图)表达仍未被广泛研究,导致地图理解复杂、扩展性差。本文提出vS-Graphs,一种实时VSLAM框架,融合视觉场景理解与地图重建,并采用可解释的图结构表示。该框架从检测到的墙体和地面等建筑构件中推断出房间与楼层等结构元素,并融入可优化的3D场景图中。实验表明,vS-Graphs在标准基准和真实世界数据集上相较最先进VSLAM方法平均提升15.22%的定位精度;同时,仅使用视觉特征即达到接近激光雷达框架的环境驱动语义实体检测性能。代码已公开于https://github.com/snt-arg/visual_sgraphs,更多成果见https://snt-arg.github.io/vsgraphs-results/。

原文摘要 · Abstract (English)

Current Visual Simultaneous Localization and Mapping (VSLAM) systems often struggle to create maps that are both semantically rich and easily interpretable. While incorporating semantic scene knowledge aids in building richer maps with contextual associations among mapped objects, representing them in structured formats, such as scene graphs, has not been widely addressed, resulting in complex map comprehension and limited scalability. This paper introduces vS-Graphs, a novel real-time VSLAM framework that integrates vision-based scene understanding with map reconstruction and comprehensible graph-based representation. The framework infers structural elements (i.e., rooms and floors) from detected building components (i.e., walls and ground surfaces) and incorporates them into optimizable 3D scene graphs. This solution enhances the reconstructed map's semantic richness, comprehensibility, and localization accuracy. Extensive experiments on standard benchmarks and real-world datasets demonstrate that vS-Graphs achieves an average of 15.22% accuracy gain across all tested datasets compared to state-of-the-art VSLAM methods. Furthermore, the proposed framework achieves environment-driven semantic entity detection accuracy comparable to that of precise LiDAR-based frameworks, using only visual features. The code is publicly available at https://github.com/snt-arg/visual_sgraphs and is actively being improved. Moreover, a web page containing more media and evaluation outcomes is available on https://snt-arg.github.io/vsgraphs-results/.

视觉SLAM场景图语义建图3D理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。