arXiv:2605.13621cs.CV2026-05被引 1

通过频域分解提升红外可见光目标检测性能

WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning

论文配图:WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning
图 1 · 摘自论文原文
  • 在低频高斯域分离共享与特定特征,实现更精准融合
  • 在三个数据集上达到当前最佳检测效果,显著优于基线
  • 适合需要跨模态融合的智能监控与自动驾驶场景

红外-可见光目标检测通过融合多谱图像的互补特征提升性能。现有基于主干网络特定或共享的方法仍存在模态共享特征偏差严重、模态特异性特征不足的问题。为此,我们提出新型检测框架WD-FQDet,从低频与高频域的新视角显式解耦红外与可见模态的共享与特定信息,使融合策略可适配其频率特性。具体地,提出低频同质性对齐模块,通过跨模态注意力对齐模态共享特征;提出高频特异性保持模块,利用多尺度梯度一致性损失保留模态特定特征。为进一步增强频域特征表示,设计融合空间线索的混合特征增强模块。同时,考虑到同质与特定特征在不同场景下的贡献差异,提出频率感知查询选择模块,动态调节二者权重。在FLIR、LLVIP和M3FD数据集上的实验表明,WD-FQDet在多个评估指标上均达到当前最优性能。

原文摘要 · Abstract (English)

Infrared-visible object detection improves detection performance by combining complementary features from multispectral images. Existing backbone-specific and backbone-shared approaches still suffer from the problems of severe bias of modality-shared features and the insufficiency of modality-specific features. To address these issues, we propose a novel detection framework WD-FQDet that explicitly decouples modality-shared and modality-specific information from infrared and visible modalities in the new view of low- and high-frequency domains, allowing fusion strategies tailored to their frequency characteristics. Specifically, a low-frequency homogeneity alignment module is proposed to align modality-shared features across modalities via a cross-modal attention mechanism, and a high-frequency specificity retention module is proposed to preserve modality-specific features through the multi-scale gradient consistency loss. To reinforce the feature representation in the frequency domain, we propose a hybrid feature enhancement module that incorporates spatial cues. Furthermore, considering that the contributions of homogeneous and modality-specific features to object detection vary across scenarios, we propose a frequency-aware query selection module to dynamically regulate their contributions. Experimental results on the FLIR, LLVIP, and M3FD datasets demonstrate that WD-FQDet achieves state-of-the-art performance across multiple evaluation metrics.

多模态检测频域分析目标检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。