arXiv:2512.21495cs.CV2025-12

用生成模型融合多焦点图像,消除边缘伪影,提升细节还原。

Generative Multi-Focus Image Fusion

  • 分两阶段:先确定性融合,再用生成模型修复缺失焦点信息。
  • 在多个数据集上达到当前最好效果,显著减少边缘伪影。
  • 适合复杂场景下的高精度图像融合应用。

多焦点图像融合旨在从一系列部分聚焦的输入图像中生成全清晰图像。现有算法通常假设场景中每个空间位置至少有一张输入图像是清晰的,但在真实复杂场景中,因焦点估计不确定或硬选择操作,常出现边缘伪影。为此,本文提出一种生成式多焦点图像融合框架GMFF,包含两个连续阶段:第一阶段使用StackMFF V4对可用焦点平面信息进行确定性融合,生成初始融合图像;第二阶段通过IFControlNet利用潜在扩散模型的生成能力,重建缺失焦点平面内容,恢复精细细节并消除边缘伪影。两阶段独立开发,级联运行无缝衔接。大量实验表明,GMFF在多个数据集上实现领先性能,尤其在复杂多焦点内容场景中展现显著应用潜力。代码已开源:https://github.com/Xinzhe99/StackMFF-Series。

原文摘要 · Abstract (English)

Multi-focus image fusion aims to generate an all-in-focus image from a sequence of partially focused input images. Existing fusion algorithms generally assume that, for every spatial location in the scene, there is at least one input image in which that location is in focus. Furthermore, current fusion models often suffer from edge artifacts caused by uncertain focus estimation or hard-selection operations in complex real-world scenarios. To address these limitations, we propose a generative multi-focus image fusion framework, termed GMFF, which operates in two sequential stages. In the first stage, deterministic fusion is implemented using StackMFF V4, the latest version of the StackMFF series, and integrates the available focal plane information to produce an initial fused image. The second stage, generative restoration, is realized through IFControlNet, which leverages the generative capabilities of latent diffusion models to reconstruct content from missing focal planes, restore fine details, and eliminate edge artifacts. Each stage is independently developed and functions seamlessly in a cascaded manner. Extensive experiments demonstrate that GMFF achieves state-of-the-art fusion performance and exhibits significant potential for practical applications, particularly in scenarios involving complex multi-focal content. The implementation is publicly available at https://github.com/Xinzhe99/StackMFF-Series.

图像融合生成模型扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。