构建首个多源遥感融合检测数据集,提升复杂环境目标识别精度
M4-SAR: A Multi-Resolution, Multi-Polarization, Multi-Scene, Multi-Source Dataset and Benchmark for optical-SAR Object Detection
- 构建跨分辨率、极化、场景、来源的光学与SAR图像对齐数据集
- 融合多源数据使平均精度提升5.7%,复杂环境下增益更显著
- 提供端到端融合框架和基准工具,助力遥感检测研究
单一源遥感目标检测在复杂环境中表现受限:光学图像虽具丰富纹理细节,但易受光照不足、云遮蔽或低分辨率影响;合成孔径雷达(SAR)图像抗天气干扰强,却存在斑点噪声且语义表达能力弱。光学与SAR图像具有互补优势,融合可显著提升检测性能。然而该领域进展受限于缺乏大规模标准化数据集。为此,我们提出多分辨率、多极化、多场景、多源合成孔径雷达数据集(M4-SAR),包含112,174对实例级对齐图像及近百万个标注实例(含任意方向),涵盖六类关键目标。为实现标准化评估,我们开发集成六种先进多源融合方法的统一基准工具包,并提出E2E-OSDet端到端多源融合检测框架,有效缓解跨域差异,建立稳健基线。在M4-SAR上的大量实验表明,融合光学与SAR数据相比单源输入可提升平均精度5.7%,尤其在复杂环境下效果更优。数据集与代码已公开于https://github.com/wchao0601/M4-SAR。
原文摘要 · Abstract (English)
Single-source remote sensing object detection using optical or SAR images struggles in complex environments. Optical images offer rich textural details but are often affected by low-light, cloud-obscured, or low-resolution conditions, reducing the detection performance. SAR images are robust to weather, but suffer from speckle noise and limited semantic expressiveness. Optical and SAR images provide complementary advantages, and fusing them can significantly improve the detection accuracy. However, progress in this field is hindered by the lack of large-scale, standardized datasets. To address these challenges, we propose a new comprehensive dataset for optical-SAR fusion object detection, named Multi-resolution, Multi-polarization, Multi-scene, Multi-source SAR dataset (M4-SAR). It contains 112,174 instance-level aligned image pairs and nearly one million labeled instances with arbitrary orientations, spanning six key categories. To enable standardized evaluation, we develop a unified benchmarking toolkit that integrates six state-of-the-art multi-source fusion methods. Additionally, we propose E2E-OSDet, a novel end-to-end multi-source fusion detection framework that mitigates cross-domain discrepancies and establishes a robust baseline for future studies. Extensive experiments on M4-SAR demonstrate that fusing optical and SAR data can improve mAP by 5.7\% over single-source inputs, with particularly significant gains in complex environments. The dataset and code are publicly available at https://github.com/wchao0601/M4-SAR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。