通过动态图建模不确定性,提升复杂场景下显著目标检测的细节与鲁棒性。
Graph-Based Uncertainty Modeling and Multimodal Fusion for Salient Object Detection
- 构建空间语义距离图,动态传播不确定性并融合通道自适应交互
- 多模态加权融合注意力图,提升遮挡与弱纹理下的检测精度
- 适合需要高细节、强抗干扰能力的显著目标检测任务
针对现有显著目标检测方法在复杂场景中易丢失细节、边缘模糊及单模态信息融合不足的问题,本文提出动态不确定性传播与多模态协同推理网络(DUP-MCRNet)。首先设计动态不确定性图卷积模块(DUGC),基于空间语义距离构建稀疏图,在层间传播不确定性,并结合通道自适应交互,有效提升小结构与边缘区域的检测精度。其次提出多模态协同融合策略(MCF),利用可学习的模态门控权重对RGB、深度和边缘特征的注意力图进行加权融合,根据场景动态调整各模态重要性,抑制冗余或干扰信息,增强跨模态语义互补性与一致性,从而提升遮挡、弱纹理或背景干扰下的识别能力。最后通过多尺度BCE与IoU损失、跨尺度一致性约束及不确定性引导监督机制优化像素级与区域级性能。大量实验表明,DUP-MCRNet在多数主流基准数据集上优于现有方法,尤其在边缘清晰度与复杂背景鲁棒性方面表现突出。代码已开源:https://github.com/YukiBear426/DUP-MCRNet。
原文摘要 · Abstract (English)
In view of the problems that existing salient object detection (SOD) methods are prone to losing details, blurring edges, and insufficient fusion of single-modal information in complex scenes, this paper proposes a dynamic uncertainty propagation and multimodal collaborative reasoning network (DUP-MCRNet). Firstly, a dynamic uncertainty graph convolution module (DUGC) is designed to propagate uncertainty between layers through a sparse graph constructed based on spatial semantic distance, and combined with channel adaptive interaction, it effectively improves the detection accuracy of small structures and edge regions. Secondly, a multimodal collaborative fusion strategy (MCF) is proposed, which uses learnable modality gating weights to weightedly fuse the attention maps of RGB, depth, and edge features. It can dynamically adjust the importance of each modality according to different scenes, effectively suppress redundant or interfering information, and strengthen the semantic complementarity and consistency between cross-modalities, thereby improving the ability to identify salient regions under occlusion, weak texture or background interference. Finally, the detection performance at the pixel level and region level is optimized through multi-scale BCE and IoU loss, cross-scale consistency constraints, and uncertainty-guided supervision mechanisms. Extensive experiments show that DUP-MCRNet outperforms various SOD methods on most common benchmark datasets, especially in terms of edge clarity and robustness to complex backgrounds. Our code is publicly available at https://github.com/YukiBear426/DUP-MCRNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。