arXiv:2410.06478eess.IVcs.CV2024-10中稿 · IEEE Transactions …被引 3

提出空间与视角联合增强方法,提升光场图像超分辨率性能

MaskBlur: Spatial and Angular Data Augmentation for Light Field Image Super-Resolution

  • 设计空间模糊与视角丢弃双组件,同步处理光场图像的空间和视角信息
  • 在多个光场任务中显著提升模型性能,尤其在真实场景超分中效果突出
  • 适用于光场图像修复、去噪、低光增强等下游任务,代码开源可复现

数据增强是提升有限数据下模型性能的有效方法,如光场(LF)图像超分辨率(SR)。LF图像天然蕴含丰富的空间和视角信息,但现有增强方法多仅关注空间或视角单一维度,缺乏针对光场特性的联合增强策略。本文提出一种名为MaskBlur的新颖空间-视角联合数据增强方法,包含空间模糊与视角丢弃两个组件:空间模糊由空间掩码控制,实现高低分辨率域像素的混合;视角掩码决定哪些视角执行模糊操作。该机制使模型在超分时能差异化处理不同空间与视角位置的像素,而非均一化处理。大量实验表明,MaskBlur能显著提升现有SR方法性能,并成功扩展至去噪、去模糊、低光增强及真实场景超分等任务。代码已公开于https://github.com/chaowentao/MaskBlur。

原文摘要 · Abstract (English)

Data augmentation (DA) is an effective approach for enhancing model performance with limited data, such as light field (LF) image super-resolution (SR). LF images inherently possess rich spatial and angular information. Nonetheless, there is a scarcity of DA methodologies explicitly tailored for LF images, and existing works tend to concentrate solely on either the spatial or angular domain. This paper proposes a novel spatial and angular DA strategy named MaskBlur for LF image SR by concurrently addressing spatial and angular aspects. MaskBlur consists of spatial blur and angular dropout two components. Spatial blur is governed by a spatial mask, which controls where pixels are blurred, i.e., pasting pixels between the low-resolution and high-resolution domains. The angular mask is responsible for angular dropout, i.e., selecting which views to perform the spatial blur operation. By doing so, MaskBlur enables the model to treat pixels differently in the spatial and angular domains when super-resolving LF images rather than blindly treating all pixels equally. Extensive experiments demonstrate the efficacy of MaskBlur in significantly enhancing the performance of existing SR methods. We further extend MaskBlur to other LF image tasks such as denoising, deblurring, low-light enhancement, and real-world SR. Code is publicly available at \url{https://github.com/chaowentao/MaskBlur}.

光场图像数据增强超分辨率视觉修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。