提出DehazeXL模型,实现大图去雾的全局与局部特征平衡。
Tokenize Image Patches: Global Context Fusion for Effective Haze Removal in Large Images
- 通过令牌化图像块融合全局上下文,兼顾大图建模与细节保留。
- 在21GB显存下处理10240×10240大图,性能超越现有方法。
- 构建8K级去雾数据集(8KDehaze),支持高分辨率训练与评估。
全局上下文与局部细节对去雾任务至关重要。深度学习模型在小尺寸低分辨率图像上表现良好,但在大尺寸高分辨率图像上受限于GPU内存,常采用图像切片或降采样折衷方案,前者削弱全局信息,后者丢失高频细节。为此,我们提出DehazeXL,一种能有效平衡全局上下文与局部特征提取的去雾方法,可在主流GPU硬件上端到端建模大图。为评估全局上下文利用效率,设计了面向去雾任务的视觉归因方法。针对大图去雾缺乏基准数据集的问题,构建了超高清去雾数据集8KDehaze,包含10000对清晰与模糊遥感图像,每张尺寸为8192×8192像素。大量实验表明,DehazeXL仅需21GB显存即可推断最大10240×10240像素的图像,在所有对比方法中达到最先进水平。源码与数据集已公开于https://github.com/CastleChen339/DehazeXL。
原文摘要 · Abstract (English)
Global contextual information and local detail features are essential for haze removal tasks. Deep learning models perform well on small, low-resolution images, but they encounter difficulties with large, high-resolution ones due to GPU memory limitations. As a compromise, they often resort to image slicing or downsampling. The former diminishes global information, while the latter discards high-frequency details. To address these challenges, we propose DehazeXL, a haze removal method that effectively balances global context and local feature extraction, enabling end-to-end modeling of large images on mainstream GPU hardware. Additionally, to evaluate the efficiency of global context utilization in haze removal performance, we design a visual attribution method tailored to the characteristics of haze removal tasks. Finally, recognizing the lack of benchmark datasets for haze removal in large images, we have developed an ultra-high-resolution haze removal dataset (8KDehaze) to support model training and testing. It includes 10000 pairs of clear and hazy remote sensing images, each sized at 8192 $\times$ 8192 pixels. Extensive experiments demonstrate that DehazeXL can infer images up to 10240 $\times$ 10240 pixels with only 21 GB of memory, achieving state-of-the-art results among all evaluated methods. The source code and experimental dataset are available at https://github.com/CastleChen339/DehazeXL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。