通过清晰度对比与相似性选择,实现多焦点图像融合的精准聚焦区域保留。
Clarity Contrast and Similarity Selection for Multi-Focus Image Fusion

- 引入清晰度对比注意力模块,增强锐利特征并抑制模糊区域。
- 在边界区域利用相似性策略重建图像,提升模糊区融合精度。
- 适合需要高保真图像融合的应用,如医学成像和显微视觉。
多焦点图像融合(MFIF)旨在从同一场景中不同聚焦区域的多张图像生成一张全焦图像。现有深度学习方法缺乏源图像间的显式交互,限制了性能与可解释性。本文提出一种新颖的清晰度对比与相似性选择网络(CSNet),以实现直接信息交换。具体而言,通过提出的清晰度对比注意力模块(CCAM),对比源图像间的清晰度差异,相互增强锐利特征并抑制模糊特征,从而精确定位每张源图像中的聚焦区域及聚焦-非聚焦边界。此外,由于离焦扩散效应(DSE)会使边界附近像素质量下降,为进一步优化这些模糊区域,引入相似性选择策略:基于源图像重构初始清晰图像,并通过比较像素间相似性选择最优像素。该交互式方法有效保留聚焦区域并恢复自然边界,融合输出全焦图像。大量实验表明,本方法在定量与定性指标上均达到当前最优性能。代码已开源:https://github.com/ZYC-HUST/CSNet。
原文摘要 · Abstract (English)
Multi-focus image fusion (MFIF) aims to generate an all-in-focus image from multiple images of the same scene focused at different regions. Most existing deep learning-based methods lack explicit interaction between the source images, which limits their performance and interpretability. This paper presents a novel Clarity Contrast and Similarity Selection Network (CSNet), to bridge direct information exchange for MFIF. Specifically, by contrasting the clarity differences between source images within our proposed Clarity Contrast Attention Module (CCAM), we mutually enhance sharp features while suppressing blurry ones. This allows us to identify the exactly focused regions in each source and locate the focused-defocused boundaries. Moreover, the Defocus Spread Effect (DSE) degrades pixels in all source images around the boundaries. To further refine these ambiguous areas, we introduce a Similarity Selection Strategy, which reconstructs an initial clear image from source images and selects optimal pixels by comparing the similarity among them. Through this interactive approach, CSNet effectively preserves focused regions as well as recovering natural boundaries to fuse an all-in-focus output. Extensive experiments demonstrate that our method achieves state-of-the-art performance both quantitatively and qualitatively. Our code is available on Github: https://github.com/ZYC-HUST/CSNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。