用无监督方法分析20世纪中期城市卫星图,破解历史影像难标注难题。
WakeupUrban: Unsupervised Semantic Segmentation of Mid-20$^{th}$ century Urban Landscapes with Satellite Imagery
- 构建无监督分割框架WakeupUSM,利用自监督学习生成可靠伪标签。
- 在近1000平方公里的历史城市区域上实现领先分割精度,优于现有方法。
- 适合研究城市演化、历史地理的学者使用,开源数据与代码已发布。
历史卫星影像档案(如Keyhole数据)为理解早期城市化和长期变迁提供了独特视角,但严重的质量退化(如畸变、错位、光谱稀缺)及缺乏标注长期阻碍其分析。为此,我们提出WakeupUrbanBench——首个基于20世纪中期遥感影像的专家标注分割数据集,涵盖4个关键城市类别,覆盖2大洲4座城市近1000平方公里多样城市形态,并新增一座现当代城市。同时,提出无监督分割框架WakeupUSM,采用置信度感知对齐机制与聚焦置信损失,基于自监督学习架构生成鲁棒伪标签,自适应优化预测难度与标签可靠性,在无人工标注条件下显著提升对噪声历史数据的分割性能。大量实验表明,WakeupUSM在自建数据集与公开数据集上均显著优于现有无监督方法,有望推动基于现代计算机视觉的长期城市变迁定量研究。数据集与代码将开源。
原文摘要 · Abstract (English)
Historical satellite imagery archive, such as Keyhole satellite data, offers rare insights into understanding early urban development and long-term transformation. However, severe quality degradation ($\textit{e.g.}$, distortion, misalignment, and spectral scarcity) and the absence of annotations have long hindered its analysis. To bridge this gap and enhance understanding of urban development, we introduce $\textbf{WakeupUrbanBench}$, an annotated segmentation dataset based on historical satellite imagery with the earliest observation time among all existing remote sensing (RS) datasets, along with a framework for unsupervised segmentation tasks, $\textbf{WakeupUSM}$. First, WakeupUrbanBench serves as a pioneer, expertly annotated dataset built on mid-$20^{\text{th}}$ century RS imagery, involving four key urban classes and spanning 4 cities across 2 continents with nearly 1000 km$^2$ area of diverse urban morphologies, and additionally introducing one present-day city. Second, WakeupUSM is a novel unsupervised semantic segmentation framework for historical RS imagery. It employs a confidence-aware alignment mechanism and focal-confidence loss based on a self-supervised learning architecture, which generates robust pseudo-labels and adaptively prioritizes prediction difficulty and label reliability to improve unsupervised segmentation on noisy historical data without manual supervision. Comprehensive experiments demonstrate WakeupUSM significantly outperforms existing unsupervised segmentation methods $\textbf{both WakeupUrbanBench and public dataset}$, promising to pave the way for quantitative studies of long-term urban change using modern computer vision. Our benchmark and codes will be released at https://github.com/Tianxiang-Hao/WakeupUrban.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。