arXiv:2409.05679cs.CV2024-09被引 1

基于历史正常变化模式,零样本检测地球异常变化。

AnomalyCD: A benchmark for Earth anomaly change detection with high-resolution and time-series observations

  • 从历史正常变化中学习,自动识别异常变化。
  • 支持多时相、不定长度输入,无需人工标注。
  • 适合监测罕见或未知异常,如灾害、非法活动。

多种地球异常破坏了稳定平衡状态,造成人员伤亡和财产严重损失。高分辨率遥感影像凭借大范围、高精度观测优势,被广泛用于异常监测与定位。得益于深度表征能力,现有方法在分类与变化检测方面取得显著进展,但受限于异常样本稀少难以获取标签,且模型仅针对固定类别训练,难以应对少量样本或未知异常。为此,本文提出异常变化检测(AnomalyCD)技术,通过学习历史正常变化模式,识别异常变化。该技术可处理任意数量的时序输入,统一定位各类异常,无需人工监督。为基准化该技术,我们构建了包含高分辨率(0.15–2.39米/像素)、多时相(3–7时相)、大范围(共1927.93平方公里)全球图像的AnomalyCDD数据集。同时开发了零样本基线模型AnomalyCDM,利用段落任何模型(SAM)提取通用特征,通过时序对比区分异常与正常变化。AnomalyCDM采用两阶段流程提升效率,可直接处理未见场景图像,无需重新训练。

原文摘要 · Abstract (English)

Various Earth anomalies have destroyed the stable, balanced state, resulting in fatalities and serious destruction of property. With the advantages of large-scale and precise observation, high-resolution remote sensing images have been widely used for anomaly monitoring and localization. Powered by the deep representation, the existing methods have achieved remarkable advances, primarily in classification and change detection techniques. However, labeled samples are difficult to acquire due to the low probability of anomaly occurrence, and the trained models are limited to fixed anomaly categories, which hinders the application for anomalies with few samples or unknown anomalies. In this paper, to tackle this problem, we propose the anomaly change detection (AnomalyCD) technique, which accepts time-series observations and learns to identify anomalous changes by learning from the historical normal change pattern. Compared to the existing techniques, AnomalyCD processes an unfixed number of time steps and can localize the various anomalies in a unified manner, without human supervision. To benchmark AnomalyCD, we constructed a high-resolution dataset with time-series images dedicated to various Earth anomalies (the AnomalyCDD dataset). AnomalyCDD contains high-resolution (from 0.15 to 2.39 m/pixel), time-series (from 3 to 7 time steps), and large-scale images (1927.93 km2 in total) collected globally Furthermore, we developed a zero-shot baseline model (AnomalyCDM), which implements the AnomalyCD technique by extracting a general representation from the segment anything model (SAM) and conducting temporal comparison to distinguish the anomalous changes from normal changes. AnomalyCDM is designed as a two-stage workflow to enhance the efficiency, and has the ability to process the unseen images directly, without retraining for each scene.

异常检测遥感时序分析零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。