arXiv:2506.23537eess.IVcs.CV2025-06ICCV被引 18

基于数学优化的端到端网络,通过交替对齐与融合提升高动态范围图像重建质量。

AFUNet: Cross-Iterative Alignment-Fusion Synergy for HDR Reconstruction via Deep Unfolding Paradigm

  • 将对齐与融合任务交替迭代优化,实现两者协同增效。
  • 在多个数据集上优于现有方法,峰值信噪比提升0.2~0.5dB。
  • 适合需要高精度图像重建的研究者与开发者参考。

现有基于学习的方法虽能从多曝光低动态范围(LDR)输入中重建高动态范围(HDR)图像,但更多依赖经验设计而非理论基础,影响可靠性。为此,我们提出交叉迭代对齐-融合深度展开网络(AFUNet),将HDR重建系统性分解为对齐与融合两个交替优化的子任务,通过交替精炼实现协同增效。从最大后验估计(MAP)视角建模,显式引入跨LDR图像的空间对应先验,并通过联合约束自然连接对齐与融合问题。基于此数学基础,我们将传统迭代优化过程重构为可端到端训练的AFUNet,设计逐层推进的模块。每轮迭代包含对齐-融合模块(AFM),交替执行空间对齐模块(SAM)与通道融合模块(CFM),逐步弥合内容错位与曝光差异。大量定性和定量评估表明,AFUNet性能显著优于当前最优方法。代码已开源:https://github.com/eezkni/AFUNet。

原文摘要 · Abstract (English)

Existing learning-based methods effectively reconstruct HDR images from multi-exposure LDR inputs with extended dynamic range and improved detail, but they rely more on empirical design rather than theoretical foundation, which can impact their reliability. To address these limitations, we propose the cross-iterative Alignment and Fusion deep Unfolding Network (AFUNet), where HDR reconstruction is systematically decoupled into two interleaved subtasks -- alignment and fusion -- optimized through alternating refinement, achieving synergy between the two subtasks to enhance the overall performance. Our method formulates multi-exposure HDR reconstruction from a Maximum A Posteriori (MAP) estimation perspective, explicitly incorporating spatial correspondence priors across LDR images and naturally bridging the alignment and fusion subproblems through joint constraints. Building on the mathematical foundation, we reimagine traditional iterative optimization through unfolding -- transforming the conventional solution process into an end-to-end trainable AFUNet with carefully designed modules that work progressively. Specifically, each iteration of AFUNet incorporates an Alignment-Fusion Module (AFM) that alternates between a Spatial Alignment Module (SAM) for alignment and a Channel Fusion Module (CFM) for adaptive feature fusion, progressively bridging misaligned content and exposure discrepancies. Extensive qualitative and quantitative evaluations demonstrate AFUNet's superior performance, consistently surpassing state-of-the-art methods. Our code is available at: https://github.com/eezkni/AFUNet

HDR重建深度展开图像对齐特征融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。