用频域+多尺度结构,高效去除玻璃反射。
F2T2-HiT: A U-Shaped FFT Transformer and Hierarchical Transformer for Reflection Removal
- 融合FFT与分层Transformer,捕捉全局反射特征。
- 在三个数据集上达到当前最佳效果,有效处理不同强度反射。
- 适合图像去反射场景,尤其对复杂反射有强鲁棒性。
单图像反射去除(SIRR)技术在图像处理中至关重要,可消除透过玻璃拍摄时产生的干扰反射。这些反射因真实场景中光照、形状、大小和覆盖范围差异大,导致现有方法难以应对。本文提出一种基于UNet架构的新型F2T2-HiT网络,结合快速傅里叶变换(FFT)Transformer块与分层Transformer块:前者利用全局频域信息分离反射模式,后者通过多尺度特征提取处理不同尺寸和复杂度的反射。在三个公开数据集上的大量实验表明,该方法性能达到当前最优水平,验证了其有效性。
原文摘要 · Abstract (English)
Single Image Reflection Removal (SIRR) technique plays a crucial role in image processing by eliminating unwanted reflections from the background. These reflections, often caused by photographs taken through glass surfaces, can significantly degrade image quality. SIRR remains a challenging problem due to the complex and varied reflections encountered in real-world scenarios. These reflections vary significantly in intensity, shapes, light sources, sizes, and coverage areas across the image, posing challenges for most existing methods to effectively handle all cases. To address these challenges, this paper introduces a U-shaped Fast Fourier Transform Transformer and Hierarchical Transformer (F2T2-HiT) architecture, an innovative Transformer-based design for SIRR. Our approach uniquely combines Fast Fourier Transform (FFT) Transformer blocks and Hierarchical Transformer blocks within a UNet framework. The FFT Transformer blocks leverage the global frequency domain information to effectively capture and separate reflection patterns, while the Hierarchical Transformer blocks utilize multi-scale feature extraction to handle reflections of varying sizes and complexities. Extensive experiments conducted on three publicly available testing datasets demonstrate state-of-the-art performance, validating the effectiveness of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。