arXiv:2605.22581cs.CVcs.AI2026-05被引 1

用3D重建实现复杂建筑中的精准定位,仅需一张图也能工作。

SceneAligner: 3D-Grounded Floorplan Localization in the Wild

论文配图:SceneAligner: 3D-Grounded Floorplan Localization in the Wild
图 1 · 摘自论文原文
  • 基于图像重建3D场景并生成2D密度图作为地板图代理
  • 在仅一张图像情况下仍可实现高精度定位,优于现有方法
  • 适合大规模真实场景的定位任务,尤其适用于无精确地图的环境

许多公共建筑提供带有“您在此处”指示的平面图以帮助访客导航。平面图定位旨在通过计算方式复现此功能,确定视觉观测数据在平面图中的位置。然而,现有方法通常假设受控的小规模环境和精确的矢量平面图,限制了其在大规模建筑和栅格化平面图中的应用。本文提出一种在真实复杂环境中进行平面图定位的方法,将任务建立在场景的重建3D表示基础上。给定非受限的图像集合,该方法重建一个重力对齐的3D场景,并将其投影为二维密度图,作为平面图代理。平面图定位被建模为通过二维相似变换对齐该代理与输入平面图。为弥合密度图与建筑平面图之间的外观差异,我们采用2D基础模型学习跨模态对应关系,引入一种微调方案,鼓励语义对齐匹配的同时保持结构一致性。大量实验表明,该方法显著优于先前方法,包括在极端稀疏设置下仅使用单张输入图像时也表现优异。代码与数据将公开发布。

原文摘要 · Abstract (English)

Many public buildings provide floorplans with a "you are here" indicator to help visitors orient themselves. Floorplan localization seeks to computationally replicate this capability by determining where visual observations were captured within a floorplan. However, existing methods typically assume controlled small-scale environments and precise vectorized floorplans, limiting their ability to operate in large-scale buildings and rasterized floorplans. In this work, we present an approach for performing floorplan localization in the wild by grounding the task in a reconstructed 3D representation of the scene. Given an unconstrained image collection, our method reconstructs a gravity-aligned 3D scene and projects it into a 2D density map that serves as a floorplan proxy. Floorplan localization is then formulated as aligning this proxy with the input floorplan via a 2D similarity transform. To bridge the appearance gap between density maps and architectural floorplans, we adapt a 2D foundation model to learn cross-modal correspondences, introducing a fine-tuning scheme that encourages semantically aligned matches while preserving structural consistency. Extensive experiments demonstrate substantial improvements over prior methods, including in extremely sparse settings with as little as a single input image. Our code and data will be publicly available.

三维重建定位平面图图像引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。