用合成数据重训模型,提升遥感建筑检测跨区域泛化能力
Synthetic Data Matters: Re-training with Geo-typical Synthetic Labels for Building Detection

- 基于目标区域地理结构生成典型合成数据
- 实测提升达12%,缓解跨域差异问题
- 无需大量标注,适合资源有限的遥感应用
深度学习显著推进了遥感建筑分割,但因城市布局和建筑类型、大小、位置分布差异,模型在不同地理区域泛化能力差。而获取覆盖全球多样性的标注数据耗时且难以满足日益增长的数据需求。为此,本文提出一种新方法:在测试时利用针对目标区域城市布局的合成数据重新训练模型。通过使用OpenStreetMap的路网等地理空间数据,结合过程化建模与物理渲染,生成高分辨率合成图像,并在建筑形状、材质和光照上引入领域随机化,实现近乎无限的训练样本,同时保留目标环境核心特征。为克服合成到真实的数据域差距,该方法将地理典型数据融入对抗性域自适应框架进行建筑分割。实验表明,性能显著提升,中位数改善达12%,具体效果取决于域差距程度。该可扩展、低成本的方法融合部分地理知识与合成图像,为解决纯合成数据集的“模型坍缩”问题提供可行路径,无需大量真实标注即可提升遥感建筑分割的泛化能力。
原文摘要 · Abstract (English)
Deep learning has significantly advanced building segmentation in remote sensing, yet models struggle to generalize on data of diverse geographic regions due to variations in city layouts and the distribution of building types, sizes and locations. However, the amount of time-consuming annotated data for capturing worldwide diversity may never catch up with the demands of increasingly data-hungry models. Thus, we propose a novel approach: re-training models at test time using synthetic data tailored to the target region's city layout. This method generates geo-typical synthetic data that closely replicates the urban structure of a target area by leveraging geospatial data such as street network from OpenStreetMap. Using procedural modeling and physics-based rendering, very high-resolution synthetic images are created, incorporating domain randomization in building shapes, materials, and environmental illumination. This enables the generation of virtually unlimited training samples that maintain the essential characteristics of the target environment. To overcome synthetic-to-real domain gaps, our approach integrates geo-typical data into an adversarial domain adaptation framework for building segmentation. Experiments demonstrate significant performance enhancements, with median improvements of up to 12%, depending on the domain gap. This scalable and cost-effective method blends partial geographic knowledge with synthetic imagery, providing a promising solution to the "model collapse" issue in purely synthetic datasets. It offers a practical pathway to improving generalization in remote sensing building segmentation without extensive real-world annotations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。