提出双域渐进融合网络,提升红外可见光目标检测的精度与鲁棒性。
DRPFNet: Dual-domain Residual Progressive Fusion Network for RGB-Thermal Object Detection

- 分结构、特征、增强三层次协同融合,解决跨尺度信息丢失问题
- 通过频域分离与边缘引导,保留红外图像低频结构和可见光高频边缘
- 适合复杂光照天气下目标检测任务,尤其对小目标识别有明显提升
RGB-thermal(RGB-T)目标检测旨在融合可见光与热成像的互补信息,以在不同光照和天气条件下实现鲁棒检测。现有方法通常在每个特征层级独立使用注意力机制或Transformer进行跨模态融合,直接在空间域合并特征。然而,这些方法仍存在显著局限:各层级独立融合导致跨层级知识继承不足;缺乏双向优化使噪声持续放大;缺少频域-空间协同,引发信息退化。为此,本文提出DRPFNet——一种双域残差渐进融合网络,构建从结构、特征到增强三个协同层次的统一信息优化体系。在结构层面,通过自底向上的知识累积与双向增强,实现跨尺度信息流畅传递;在特征层面,通过频带分离与边缘引导,协同提取可见光高频边缘与热成像低频结构,保障表征质量;在增强层面,基于边缘引导的双域精炼,强化前景-背景区分,实现精确目标定位。在两个公开的RGB-T数据集上进行的大量实验表明,该方法在保持高效的同时达到具有竞争力的性能,验证了这种分层协同策略的有效性。
原文摘要 · Abstract (English)
RGB-thermal (RGB-T) object detection aims to fuse complementary information from visible and thermal modalities to achieve robust detection under varying illumination and weather conditions. Current methods typically employ attention mechanisms or transformers to perform cross-modal fusion independently at each feature scale, directly combining RGB and thermal features in the spatial domain. However, they still face significant limitations: cross-level knowledge inheritance caused by independent fusion at each scale,suppressing noise continuously due to the lack of bidirectional optimization, and information degradation induced by the absence of frequency-spatial collaboration. To address these issues, we propose DRPFNet, a Dual-domain Residual Progressive Fusion Network that constructs a unified information flow optimization system from three synergistic levels:structure, feature, and enhancement. At the structural level, we establish cross-scale propagation through bottom-up knowledge accumulation and bidirectional enhancement,ensuring smooth information flow. At the feature level, we collaboratively extract RGB high-frequency edges and thermal low-frequency structures via frequency band separation and edge guidance, guaranteeing representation quality. At the enhancement level, we enhance foreground-background discrimination through edge-guided dual-domain refinement,achieving precise object localization.Extensive experiments on two public RGB-T datasets demonstrate that our method achieves competitive performance with competitive efficiency, validating the effectiveness of this hierarchical collaborative strategy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。