用历史地图数据修正航拍图中的屋顶与建筑轮廓,提升城市分析精度。
DragOSM: Extract Building Roofs and Footprints from Aerial Images by Aligning Historical Labels
- 引入对齐标记,通过高斯分布建模位置偏差并迭代修正标签。
- 在17.9万栋建筑上验证,显著改善了旧地图数据与新航拍图的错位问题。
- 适合做城市测绘、遥感分析的研究者和开发者使用。
从遥感图像中提取多边形屋顶和建筑轮廓对于大规模城市分析至关重要。现有方法依赖分割模型,假设屋顶有清晰语义边界,但在非正射图像中,屋顶与轮廓位移严重,立面像素与屋顶边界融合,导致效果不佳。随着开源矢量地图(如OpenStreetMap)的普及,利用历史标注进行非正射图像标注成为可能,因遥感图像捕获后可地理定位。然而,这些历史标注常存在明显位置偏差,且仅提供屋顶或轮廓之一,无法准确描述建筑结构。为此,我们提出对齐标记概念,编码校正向量以引导标签修正;基于此,构建Drag OpenStreetMap Labels(DragOSM)模型,将标签对齐建模为交互式去噪过程,将位置偏差建模为高斯分布。训练时通过随机高斯扰动模拟错位;推理时迭代优化输入标签位置。为验证方法,我们构建新数据集ReBO,包含5,473张图像、41个城市的179,265栋建筑,涵盖OpenStreetMap与人工修正标注。实验结果表明DragOSM有效。代码、数据及训练模型已公开于https://github.com/likaiucas/DragOSM.git。
原文摘要 · Abstract (English)
Extracting polygonal roofs and footprints from remote sensing images is critical for large-scale urban analysis. Most existing methods rely on segmentation-based models that assume clear semantic boundaries of roofs, but these approaches struggle in off- nadir images, where the roof and footprint are significantly displaced, and facade pixels are fused with the roof boundary. With the increasing availability of open vector map annotations, e.g., OpenStreetMap, utilizing historical labels for off-nadir image annotation has become viable because remote sensing images are georeferenced once captured. However, these historical labels commonly suffer from significant positional discrepancies with new images and only have one annotation (roof or footprint), which fails to describe the correct structures of a building. To address these discrepancies, we first introduce a concept of an alignment token, which encodes the correction vector to guide the label correction. Based on this concept, we then propose Drag OpenStreetMap Labels (DragOSM), a novel model designed to align dislocated historical labels with roofs and footprints. Specifically, DragOSM formulates the label alignment as an interactive denoising process, modeling the positional discrepancy as a Gaussian distribution. During training, it learns to correct these errors by simulating misalignment with random Gaussian perturbations; during inference, it iteratively refines the positions of input labels. To validate our method, we further present a new dataset, Repairing Buildings in OSM (ReBO), comprising 179,265 buildings with both OpenStreetMap and manually corrected annotations across 5,473 images from 41 cities. Experimental results on ReBO demonstrate the effectiveness of DragOSM. Code, dataset, and trained models are publicly available at https://github.com/likaiucas/DragOSM.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。