arXiv:2604.05959cs.CVcs.LG2026-04被引 3

融合雷达与光学遥感数据,用多模态Transformer实现高精度滑坡检测。

Multi-Modal Landslide Detection from Sentinel-1 SAR and Sentinel-2 Optical Imagery Using Multi-Encoder Vision Transformers and Ensemble Learning

论文配图:Multi-Modal Landslide Detection from Sentinel-1 SAR and Sentinel-2 Optical Imagery Using Multi-Encoder Vision Transformers and Ensemble Learning
图 1 · 摘自论文原文
  • 分别用轻量编码器处理雷达和光学影像,提升多源数据融合能力
  • 在滑坡分类任务中达F1分数0.919,优于现有方法
  • 支持单模或双模输入,适合实际灾害监测应用

滑坡是严重威胁人类生命、基础设施和生态系统的重大地质灾害,亟需精准及时的检测方法以支持减灾。本文提出一种模块化多模型框架,融合Sentinel-2光学影像与Sentinel-1合成孔径雷达(SAR)数据,实现鲁棒滑坡检测。方法采用多编码器视觉变换模型,每种数据模态通过独立的轻量级预训练编码器处理,显著提升检测性能。同时,结合神经网络与梯度提升模型(LightGBM、XGBoost)的集成学习策略,进一步增强准确率与鲁棒性。引入如NDVI等衍生光谱指数,配合原始波段,增强对植被及地表变化的敏感性。该方法在基于图像块的分类任务中取得0.919的F1分数,无需依赖灾前Sentinel-2数据,在非传统变化检测场景下表现优异。在机器学习竞赛中也展现出良好精度与召回平衡,凸显光学与雷达数据互补优势。实验验证了其可扩展性与业务适用性,支持光学、雷达或两者组合的灵活配置,为更广泛的自然灾害监测与环境变化分析提供可迁移框架。完整训练与推理代码见https://github.com/IoannisNasios/sentinel-landslide-cls。

原文摘要 · Abstract (English)

Landslides represent a major geohazard with severe impacts on human life, infrastructure, and ecosystems, underscoring the need for accurate and timely detection approaches to support disaster risk reduction. This study proposes a modular, multi-model framework that fuses Sentinel-2 optical imagery with Sentinel-1 Synthetic Aperture Radar (SAR) data, for robust landslide detection. The methodology leverages multi-encoder vision transformers, where each data modality is processed through separate lightweight pretrained encoders, achieving strong performance in landslide detection. In addition, the integration of multiple models, particularly the combination of neural networks and gradient boosting models (LightGBM and XGBoost), demonstrates the power of ensemble learning to further enhance accuracy and robustness. Derived spectral indices, such as NDVI, are integrated alongside original bands to enhance sensitivity to vegetation and surface changes. The proposed methodology achieves a state-of-the-art F1 score of 0.919 on landslide detection, addressing a patch-based classification task rather than pixel-level segmentation and operating without pre-event Sentinel-2 data, highlighting its effectiveness in a non-classical change detection setting. It also demonstrated top performance in a machine learning competition, achieving a strong balance between precision and recall and highlighting the advantages of explicitly leveraging the complementary strengths of optical and radar data. The conducted experiments and research also emphasize scalability and operational applicability, enabling flexible configurations with optical-only, SAR-only, or combined inputs, and offering a transferable framework for broader natural hazard monitoring and environmental change applications. Full training and inference code can be found in https://github.com/IoannisNasios/sentinel-landslide-cls.

滑坡检测多模态融合遥感分析视觉Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。