用自监督模型分析雷达影像,实现无需标注的全球地表扰动检测。
Deep Self-Supervised Disturbance Mapping with the OPERA Sentinel-1 Radiometric Terrain Corrected SAR Backscatter Product
- 基于自监督视觉变换器建模正常地表回波分布。
- 在三类灾害中F1超过0.6,曲线下面积超0.65。
- 适合无标签数据下的全球灾害监测,尤其适用于应急响应。
地表扰动制图支持灾害响应、资源与生态系统管理及气候适应。合成孔径雷达(SAR)可在任意天气和光照条件下提供连续的时间序列影像,是扰动检测的重要工具。然而,将SAR数据处理为可分析格式需专业知识与大量计算资源,尤其在大范围全球分析中。2023年10月,NASA OPERA项目发布了近全球范围的哨兵-1辐射定标地形校正后向散射(OPERA RTC-S1)数据集,提供公开可获取的分析就绪型SAR影像。本文利用该数据集系统分析地表扰动。由于标注SAR数据耗时巨大,我们采用无需标签的自监督视觉变换器,在OPERA RTC-S1数据上训练,估计基线影像的像素级分布,并在偏离模型分布显著时识别扰动。为验证模型能力与普适性,我们在三个不同地区的三种自然灾害(高烈度、突发性扰动)上进行评估。结果表明,该方法在各类事件中均实现高质量边界划分:F1分数超过0.6,精确率-召回率曲线下面积超过0.65,持续优于现有SAR扰动检测方法。研究显示,自监督视觉变换器适用于全球扰动制图,可作为无标签场景下近全球扰动监测的实用工具。
原文摘要 · Abstract (English)
Mapping land surface disturbances supports disaster response, resource and ecosystem management, and climate adaptation efforts. Synthetic aperture radar (SAR) is an invaluable tool for disturbance mapping, providing consistent time-series images of the ground regardless of weather or illumination conditions. Despite SAR's potential for disturbance mapping, processing SAR data to an analysis-ready format requires expertise and significant compute resources, particularly for large-scale global analysis. In October 2023, NASA's Observational Products for End-Users from Remote Sensing Analysis (OPERA) project released the near-global Radiometric Terrain Corrected SAR backscatter from Sentinel-1 (RTC-S1) dataset, providing publicly available, analysis-ready SAR imagery. In this work, we utilize this new dataset to systematically analyze land surface disturbances. As labeling SAR data is often prohibitively time-consuming, we train a self-supervised vision transformer - which requires no labels to train - on OPERA RTC-S1 data to estimate a per-pixel distribution from the set of baseline imagery and assess disturbances when there is significant deviation from the modeled distribution. To test our model's capability and generality, we evaluate three different natural disasters - which represent high-intensity, abrupt disturbances - from three different regions of the world. Across events, our approach yields high quality delineations: F1 scores exceeding 0.6 and Areas Under the Precision-Recall Curve exceeding 0.65, consistently outperforming existing SAR disturbance methods. Our findings suggest that a self-supervised vision transformer is well-suited for global disturbance mapping and can be a valuable tool for operational, near-global disturbance monitoring, particularly when labeled data does not exist.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。