跨模态迁移解决雷达图像船尾迹检测难题
Domain Adaptive SAR Wake Detection: Leveraging Similarity Filtering and Memory Guidance
- 用风格迁移生成类雷达图像,再通过特征相似性筛选有效样本
- 引入记忆库动态校准伪标签,提升目标域标注可靠性
- 适合做遥感图像跨模态检测的研究者和工程应用
合成孔径雷达(SAR)具备全天候、大范围观测能力,是船尾迹检测的重要工具。但其成像机制复杂,导致尾迹特征抽象且噪声多,难以准确标注。光学图像视觉线索清晰,但模型在迁移到SAR图像时因域偏移性能下降。为此,本文提出一种无监督跨模态域适应框架SimMemDA,通过实例级特征相似性过滤与特征置信度记忆引导,实现船尾迹检测。首先利用WakeGAN对光学图像进行风格迁移,生成近似SAR风格的伪图像;接着设计实例级特征相似性过滤机制,筛选出分布接近目标域的源样本,减少负向迁移;同时构建特征置信度记忆库,结合K近邻加权融合策略,动态校准目标域伪标签,提升其可靠性和稳定性;最后通过区域混合训练,融合源域标注与校准后的目标域伪标签,增强模型泛化能力。实验表明,该方法显著提升了跨模态船尾迹检测的准确率与鲁棒性,验证了其有效性与可行性。
原文摘要 · Abstract (English)
Synthetic Aperture Radar (SAR), with its all-weather and wide-area observation capabilities, serves as a crucial tool for wake detection. However, due to its complex imaging mechanism, wake features in SAR images often appear abstract and noisy, posing challenges for accurate annotation. In contrast, optical images provide more distinct visual cues, but models trained on optical data suffer from performance degradation when applied to SAR images due to domain shift. To address this cross-modal domain adaptation challenge, we propose a Similarity-Guided and Memory-Guided Domain Adaptation (termed SimMemDA) framework for unsupervised domain adaptive ship wake detection via instance-level feature similarity filtering and feature memory guidance. Specifically, to alleviate the visual discrepancy between optical and SAR images, we first utilize WakeGAN to perform style transfer on optical images, generating pseudo-images close to the SAR style. Then, instance-level feature similarity filtering mechanism is designed to identify and prioritize source samples with target-like distributions, minimizing negative transfer. Meanwhile, a Feature-Confidence Memory Bank combined with a K-nearest neighbor confidence-weighted fusion strategy is introduced to dynamically calibrate pseudo-labels in the target domain, improving the reliability and stability of pseudo-labels. Finally, the framework further enhances generalization through region-mixed training, strategically combining source annotations with calibrated target pseudo-labels. Experimental results demonstrate that the proposed SimMemDA method can improve the accuracy and robustness of cross-modal ship wake detection tasks, validating the effectiveness and feasibility of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。