DIME-Net统一增强暗光与逆光图像,自适应选择专家网络。
DIME-Net: A Dual-Illumination Adaptive Enhancement Network Based on Retinex and Mixture-of-Experts
- 用稀疏门控机制选S型专家网络,适配不同光照特征。
- 在合成与真实数据上均表现良好,无需重训练。
- 适合复杂光照下的多媒体应用,如手机摄影、自动驾驶。
复杂光照条件(如暗光、逆光)导致的图像退化在现实场景中普遍存在,严重影响图像质量与下游视觉任务。现有方法多针对单一光照退化类型,缺乏统一处理多种光照的能力。为此,本文提出一种双光照增强框架DIME-Net,核心为基于混合专家(Mixture-of-Experts)的光照估计模块,通过稀疏门控机制根据输入图像的光照特性自适应选择合适的S型专家网络,并结合Retinex理论,实现对暗光与逆光图像的有效增强。为进一步校正光照引起的伪影与色彩失真,设计了包含光照感知交叉注意力与顺序状态全局注意力机制的损伤恢复模块。同时构建了一个混合光照数据集MixBL,通过融合现有数据集,使模型在单次训练中即可实现对多样光照条件的鲁棒适应。实验表明,DIME-Net在合成与真实世界低光及逆光数据集上均达到竞争性性能,且无需重新训练,验证了其良好的泛化能力与实际多媒体应用潜力。
原文摘要 · Abstract (English)
Image degradation caused by complex lighting conditions such as low-light and backlit scenarios is commonly encountered in real-world environments, significantly affecting image quality and downstream vision tasks. Most existing methods focus on a single type of illumination degradation and lack the ability to handle diverse lighting conditions in a unified manner. To address this issue, we propose a dual-illumination enhancement framework called DIME-Net. The core of our method is a Mixture-of-Experts illumination estimator module, where a sparse gating mechanism adaptively selects suitable S-curve expert networks based on the illumination characteristics of the input image. By integrating Retinex theory, this module effectively performs enhancement tailored to both low-light and backlit images. To further correct illumination-induced artifacts and color distortions, we design a damage restoration module equipped with Illumination-Aware Cross Attention and Sequential-State Global Attention mechanisms. In addition, we construct a hybrid illumination dataset, MixBL, by integrating existing datasets, allowing our model to achieve robust illumination adaptability through a single training process. Experimental results show that DIME-Net achieves competitive performance on both synthetic and real-world low-light and backlit datasets without any retraining. These results demonstrate its generalization ability and potential for practical multimedia applications under diverse and complex illumination conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。