arXiv:2410.23658cs.CV2024-10NeurIPS被引 9

用3D场景生成真实多样的模糊图像,提升去模糊模型泛化能力。

GS-Blur: A 3D Scene-Based Dataset for Realistic Image Deblurring

  • 基于3D高斯点云重建场景,随机生成相机轨迹渲染模糊图
  • 数据集含多样真实模糊类型,规模大且无需人工标注
  • 适用于训练通用去模糊模型,尤其适合追求真实感的研究者

为训练去模糊网络,成对的模糊与清晰图像数据集至关重要。现有数据集通过合成连续清晰帧或使用复杂相机系统采集真实模糊图像,但模糊类型(模糊轨迹)有限,或需大量人力重建大规模数据集,难以全面反映真实世界模糊情况。为此,我们提出GS-Blur,一个基于新方法合成的逼真模糊图像数据集。首先,利用3D高斯溅射(3DGS)从多视角图像重建3D场景,再沿随机生成的运动轨迹移动相机视点渲染模糊图像。通过采用多种相机轨迹,我们的数据集包含丰富且真实的模糊类型,构建了一个大规模、可良好泛化至真实模糊场景的数据集。在多种去模糊方法上使用GS-Blur,其表现出显著优于以往合成或真实模糊数据集的泛化性能。

原文摘要 · Abstract (English)

To train a deblurring network, an appropriate dataset with paired blurry and sharp images is essential. Existing datasets collect blurry images either synthetically by aggregating consecutive sharp frames or using sophisticated camera systems to capture real blur. However, these methods offer limited diversity in blur types (blur trajectories) or require extensive human effort to reconstruct large-scale datasets, failing to fully reflect real-world blur scenarios. To address this, we propose GS-Blur, a dataset of synthesized realistic blurry images created using a novel approach. To this end, we first reconstruct 3D scenes from multi-view images using 3D Gaussian Splatting (3DGS), then render blurry images by moving the camera view along the randomly generated motion trajectories. By adopting various camera trajectories in reconstructing our GS-Blur, our dataset contains realistic and diverse types of blur, offering a large-scale dataset that generalizes well to real-world blur. Using GS-Blur with various deblurring methods, we demonstrate its ability to generalize effectively compared to previous synthetic or real blur datasets, showing significant improvements in deblurring performance.

图像去模糊3D重建数据集合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。