用动态权重网络提升极端曝光图像的修复效果
HipyrNet: Hypernet-Guided Feature Pyramid network for mixed-exposure correction
- 引入超网络动态生成特征金字塔分解核
- 在极端曝光场景下优于现有方法,定量指标显著提升
- 适合需要自适应图像增强的视觉任务研究者
近年来,深度学习在混合曝光图像增强中的图像转换应用展现出巨大潜力。然而,由于图像中区域间固有的复杂性和对比度不一致,应对极端曝光差异仍具挑战。现有方法常难以有效适应这些变化,导致性能不佳。本文提出HipyrNet,一种结合拉普拉斯金字塔框架与超网络的新方法,以解决混合曝光图像增强难题。超网络可动态生成另一网络的权重,在部署时实现动态调整。本模型中,超网络用于预测特征金字塔分解的最优卷积核,使每个输入图像都能获得定制化的自适应分解过程。增强后的转换网络采用多尺度分解与重建,借助动态核预测捕捉并操控跨尺度特征。大量实验表明,HipyrNet在极端曝光场景下优于现有方法,定性与定量评估均表现优异。该方法为混合曝光图像增强设立了新基准,推动了自适应图像转换的后续研究。
原文摘要 · Abstract (English)
Recent advancements in image translation for enhancing mixed-exposure images have demonstrated the transformative potential of deep learning algorithms. However, addressing extreme exposure variations in images remains a significant challenge due to the inherent complexity and contrast inconsistencies across regions. Current methods often struggle to adapt effectively to these variations, resulting in suboptimal performance. In this work, we propose HipyrNet, a novel approach that integrates a HyperNetwork within a Laplacian Pyramid-based framework to tackle the challenges of mixed-exposure image enhancement. The inclusion of a HyperNetwork allows the model to adapt to these exposure variations. HyperNetworks dynamically generates weights for another network, allowing dynamic changes during deployment. In our model, the HyperNetwork employed is used to predict optimal kernels for Feature Pyramid decomposition, which enables a tailored and adaptive decomposition process for each input image. Our enhanced translational network incorporates multiscale decomposition and reconstruction, leveraging dynamic kernel prediction to capture and manipulate features across varying scales. Extensive experiments demonstrate that HipyrNet outperforms existing methods, particularly in scenarios with extreme exposure variations, achieving superior results in both qualitative and quantitative evaluations. Our approach sets a new benchmark for mixed-exposure image enhancement, paving the way for future research in adaptive image translation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。