用卫星影像和深度学习,自动识别阿富汗被盗考古遗址。
Satellite-Based Detection of Looted Archaeological Sites Using Machine Learning
- 用预训练卷积网络+空间掩码,从卫星图中提取盗掘痕迹。
- 模型F1达0.926,远超传统方法的0.710,准确率显著提升。
- 适合文化遗产保护与遥感监测研究者使用。
考古遗址盗掘对文化遗产构成严重威胁,但监控数千个偏远地点仍具操作难度。本文提出一种可扩展的卫星影像检测流程,利用PlanetScope月度合成图(4.7米/像素)和阿富汗1,943个考古遗址的标注数据集(898处被盗,1,045处保存完好),包含2016至2023年多时相影像及遗址轮廓掩码。比较了两种方法:(i) 在原始RGB图像块上训练的端到端CNN分类器;(ii) 基于手工设计光谱/纹理特征和近期遥感基础模型嵌入的传统机器学习。结果表明,经ImageNet预训练的CNN结合空间掩码,取得F1分数0.926,显著优于表现最佳的传统方法(SatCLIP-V+RF+Mean,F1=0.710,即位置与视觉嵌入输入随机森林,以均值聚合时间特征)。消融实验显示,即使存在领域偏移,ImageNet预训练和空间掩码仍能提升性能。相反,地理空间基础模型嵌入与手工特征表现相当,表明盗掘痕迹具有极强局部性。代码库已公开:https://github.com/microsoft/looted_site_detection。
原文摘要 · Abstract (English)
Looting at archaeological sites poses a severe risk to cultural heritage, yet monitoring thousands of remote locations remains operationally difficult. We present a scalable and satellite-based pipeline to detect looted archaeological sites, using PlanetScope monthly mosaics (4.7m/pixel) and a curated dataset of 1,943 archaeological sites in Afghanistan (898 looted, 1,045 preserved) with multi-year imagery (2016--2023) and site-footprint masks. We compare (i) end-to-end CNN classifiers trained on raw RGB patches and (ii) traditional machine learning (ML) trained on handcrafted spectral/texture features and embeddings from recent remote-sensing foundation models. Results indicate that ImageNet-pretrained CNNs combined with spatial masking reach an F1 score of 0.926, clearly surpassing the strongest traditional ML setup, which attains an F1 score of 0.710 using SatCLIP-V+RF+Mean, i.e., location and vision embeddings fed into a Random Forest with mean-based temporal aggregation. Ablation studies demonstrate that ImageNet pretraining (even in the presence of domain shift) and spatial masking enhance performance. In contrast, geospatial foundation model embeddings perform competitively with handcrafted features, suggesting that looting signatures are extremely localized. The repository is available at https://github.com/microsoft/looted_site_detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。