构建大规模真实雾霾图像数据集,提升去雾模型在不同雾霾强度下的表现。
LMHaze: Intensity-aware Image Dehazing with a Large-scale Multi-intensity Real Haze Dataset
- 基于Mamba的专家混合模型,按雾霾强度动态调整参数。
- 数据集含超5000对高清图像,规模超现有数据集25倍。
- 首次用大模型模拟人类感知评估去雾效果,适合实际应用研究者。
近年来,图像去雾受到广泛关注。基于学习的方法通常需要成对的雾霾与无雾图像进行训练,但真实世界图像对难以获取,限制了方法发展。尽管已有工作通过合成数据或小规模真实数据缓解此问题,但现有数据集存在雾霾强度分布偏差和场景同质性问题,导致模型泛化能力受限,尤其在面对未见雾霾强度时表现不佳。本文提出LMHaze,一个大规模、高质量的真实世界图像去雾数据集,包含超过5000对高分辨率图像,覆盖多样室内室外环境及多种雾霾强度,规模超过现有最大真实数据集25倍以上。为更好处理不同雾霾强度,我们设计基于Mamba的专家混合模型(MoE-Mamba),可依据雾霾强度动态调整参数。此外,基于该数据集,我们开展基于大型多模态模型(LMM)的基准评测,模拟人类感知评估去雾效果。实验表明,LMHaze显著提升真实场景下的去雾性能,所提方法优于现有最先进方法。
原文摘要 · Abstract (English)
Image dehazing has drawn a significant attention in recent years. Learning-based methods usually require paired hazy and corresponding ground truth (haze-free) images for training. However, it is difficult to collect real-world image pairs, which prevents developments of existing methods. Although several works partially alleviate this issue by using synthetic datasets or small-scale real datasets. The haze intensity distribution bias and scene homogeneity in existing datasets limit the generalization ability of these methods, particularly when encountering images with previously unseen haze intensities. In this work, we present LMHaze, a large-scale, high-quality real-world dataset. LMHaze comprises paired hazy and haze-free images captured in diverse indoor and outdoor environments, spanning multiple scenarios and haze intensities. It contains over 5K high-resolution image pairs, surpassing the size of the biggest existing real-world dehazing dataset by over 25 times. Meanwhile, to better handle images with different haze intensities, we propose a mixture-of-experts model based on Mamba (MoE-Mamba) for dehazing, which dynamically adjusts the model parameters according to the haze intensity. Moreover, with our proposed dataset, we conduct a new large multimodal model (LMM)-based benchmark study to simulate human perception for evaluating dehazed images. Experiments demonstrate that LMHaze dataset improves the dehazing performance in real scenarios and our dehazing method provides better results compared to state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。