构建首个统一评估遥感变化检测模型的开源基准,揭示经典模型在效率上更优。
A comprehensive and trustworthy benchmark of AI methods for change detection in Earth observation

- 建立统一实验协议,跨10个数据集评估10类SOTA模型。
- 优化后的经典模型(如Siamese U-Net)在效率下超越复杂新模型。
- 公开所有资源,支持可复现研究,适合遥感与深度学习交叉研究者。
遥感变化检测对监测地表变化至关重要,但当前研究受限于评价标准不一及过度关注预测准确率而忽视计算效率。为此,我们提出一个标准化、开源的遥感变化检测深度学习模型评估基准。系统分析了从卷积网络到视觉变换器(ViTs)等十类代表性模型架构,在十个异构数据集上进行评估。所有模型采用统一实验流程,比较从零训练与使用预训练权重的效果。同时评估预测性能与计算效率,包括参数量和推理延迟。结果表明,经过优化的经典架构(如Siamese U-Net)在考虑效率时通常优于更复杂的现代模型,且预训练能显著提升性能而无需额外推理开销。为保障透明与可复现性,所有实验资源——包括标准化数据划分、训练脚本、日志和模型检查点——均公开可用,并遵循FAIR原则(可发现、可访问、可互操作、可重用)。
原文摘要 · Abstract (English)
Change detection in Earth observation (EO) is critical for monitoring land surface transformations, yet recent research in the field is constrained by inconsistent evaluation protocols and a narrow focus on predictive accuracy without regard for computational efficiency. To address this, we present a standardized, open-source benchmark for evaluating state-of-the-art (SOTA) deep learning methods for Earth observation change detection. We conduct a comprehensive analysis of ten representative model architectures, ranging from convolutional networks (CNNs) to vision transformers (ViTs), across ten heterogeneous change detection datasets. We rigorously evaluate these models with identical experimental protocols, comparing models trained from scratch against those utilizing pre-trained weights. Furthermore, we evaluate predictive performance alongside computational efficiency, including parameter counts and inference latency. Our findings reveal that well-optimized classical architectures, such as Siamese U-Nets, frequently outperform more complex contemporary models when computational efficiency is factored in, and that pre-training consistently provides a significant performance boost with no additional inference cost. To ensure complete transparency and reproducibility, all experimental resources, including standardized data splits, training scripts, training logs, and model checkpoints are publicly available and adhere to FAIR principles (Findable, Accessible, Interoperable, and Reusable).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。