arXiv:2606.17403cs.CVcs.AI2026-06

融合空间与频域特征,提升灾后建筑损毁检测精度

Bridging Spatial And Frequency Views For Disaster Assessment: Benefits And Limitations

  • 对比空间、频域及双域模型在灾损分类中的表现
  • 双域模型准确率最高达0.4688,频域单独模型最差且过拟合
  • 适合关注灾损评估中多模态特征融合的研究者

快速评估灾后卫星影像中的建筑损毁对应急响应至关重要。尽管多数深度学习方法依赖空间域特征,频域表示可捕捉碎片分布与坍塌引起的纹理等互补结构信息。本研究在xView2(xBD)数据集上,对空间域、频域及双域深度学习方法进行受控对比,所有模型均基于EfficientNet-B0骨干网络,在相同训练条件下仅改变输入表示与融合策略。通过准确率、宏平均F1分数、各类别指标和混淆矩阵评估性能。结果表明,双域模型相较单域方法有明显提升:双空间配置达到最高测试准确率(0.4688)与最低损失;空间仅模型取得最佳宏平均F1(0.4254),体现更均衡的类别表现;而频域仅模型表现最差且出现过拟合,显示泛化能力有限。尽管双域方法改善了严重损毁识别,但对细微损伤(如Minor类)仍难检测,主要因类别不平衡与细粒度视觉模糊。这些发现揭示了混合表征的优劣,推动未来在数据平衡、先进融合与正则化方面的研究。

原文摘要 · Abstract (English)

Rapid assessment of building damage from satellite imagery is essential for effective disaster response and recovery. While most deep learning methods rely on spatial-domain features, frequency-domain representations can capture complementary structural cues such as debris patterns and collapse-induced textures. This study presents a controlled comparison of spatial-domain, frequency-domain, and dual-domain deep learning approaches for multi-class building damage classification using post-disaster imagery from the xView2 (xBD) dataset. To ensure fairness, all models are built on an EfficientNet-B0 backbone and trained under identical settings, differing only in their input representations and fusion strategies. Performance is evaluated using accuracy, macro F1-score, per-class metrics, and confusion matrices. Results show that dual-domain models provide measurable improvements over single-domain approaches. The dual spatial configuration achieves the highest test accuracy (0.4688) and lowest loss, while the spatial-only model attains the best macro F1-score (0.4254), indicating more balanced class performance. In contrast, frequency-only models perform worst and exhibit overfitting, suggesting limited generalization. Despite these gains, all models struggle to detect subtle damage levels, particularly the Minor class, due to class imbalance and fine-grained visual ambiguity. While dual-domain approaches improve detection of severe damage, challenges remain. These findings highlight the benefits and limitations of hybrid representations and motivate future work on data balancing, advanced fusion, and regularization.

灾损评估双域融合遥感分析深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。