针对强光过曝导致的可见光信息丢失,提出感知曝光的融合方法,更好保留红外细节。
EPOFusion: Exposure aware Progressive Optimization Method for Infrared and Visible Image Fusion
- 通过空间引导模块选择性保留过曝区域的红外信息
- 多尺度上下文融合实现渐进式优化,提升融合图像质量28.7%
- 专设过曝数据集,适合夜间/强光场景下图像增强任务
强光照射和迎面车灯常导致可见光传感器过曝,造成视觉感知中关键信息丢失。红外与可见光图像融合可通过多模态互补来缓解此问题。然而,现有方法缺乏对过曝区域的区域感知优化,无法有效利用饱和区域中的红外线索,导致红外细节保留不足或融合结果冗余。为此,我们提出EPOFusion,一种感知曝光的融合框架。其采用空间引导模块,在过曝区域有选择地保留有信息量的红外信号;同时,配备多尺度上下文融合模块的迭代解码头,逐步优化融合表征,实现退化区域的有效红外补偿,同时保持正常区域的视觉一致性。构建了红外与可见光过曝(IVOE)数据集,包含合成训练子集用于可控监督,真实世界测试子集用于泛化评估,支持曝光感知学习与评测。在MSRS、FMB及所提IVOE基准上的大量实验表明,EPOFusion在信息保留与视觉保真度上均有提升,相比最优对比方法全图互信息(MI)平均提高28.7%。定性结果表明饱和区域补偿效果显著,下游评估也证实其在挑战性过曝条件下的优势。代码、结果与数据集将开源。
原文摘要 · Abstract (English)
Overexposure caused by strong daylight and oncoming headlights frequently overwhelms visible sensors, resulting in critical information loss in visual perception. Infrared and visible image fusion can compensate for such degradation via multimodal complementarity. However, most fusion methods lack region-aware optimization for overexposed areas and cannot effectively exploit infrared cues in saturated regions, resulting in insufficient infrared detail preservation or redundant information in the fused results. To address this, we propose EPOFusion, an exposure-aware fusion framework. It uses a spatial guidance module to selectively preserve informative infrared cues in overexposed regions. In addition, an iterative decoding head equipped with a multiscale context fusion module progressively refines fused representations, enabling effective infrared compensation in degraded regions while maintaining visual consistency in normal regions. The infrared and visible overexposure (IVOE) dataset is constructed with a synthetic training subset for controlled supervision and a real-world test subset for generalization assessment, supporting exposure-aware learning and evaluation. Extensive experiments on MSRS, FMB, and the proposed IVOE benchmark show that EPOFusion improves information preservation and visual fidelity, achieving an average full-image MI gain of 28.7% over the best competing methods. Qualitative results further demonstrate effective compensation in saturated regions, and downstream evaluations confirm its benefits under challenging overexposed conditions. Code, results, and the IVOE dataset will be made available at https://github.com/warren-wzw/EPOFusion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。