无需逐场景优化,直接从模糊图像合成清晰新视角。
DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Images

- 用几何隐空间扩散模型恢复模糊图像中的结构与对应关系
- 在合成与真实模糊数据上均优于现有方法,保持结构稳定
- 适合需要快速、通用模糊图像重建的视觉应用
新视角合成(NVS)是计算机视觉与图形学的基础问题。尽管神经辐射场(NeRF)、3D高斯泼溅(3DGS)和生成式视图合成等方法显著提升了质量,但多数仍依赖清晰观测,而运动模糊会破坏局部细节与多视角对应。此类模糊常见于相机抖动、场景运动或有限曝光拍摄。现有模糊感知方法虽建模图像形成过程,但依赖昂贵的逐场景优化,难以高效泛化至稀疏视角。为此,我们提出DeblurNVS,一种直接从稀疏运动模糊图像合成高质量新视角的框架,无需逐场景优化。该方法恢复用于多视角推理的中间几何表示,使模糊输入能重建可靠结构与对应线索,再结合目标相机信息生成目标视图表示并重构锐利RGB新视图。为支持大规模训练,我们在DL3DV-10K基础上通过插值法合成有限曝光模糊数据。大量实验表明,DeblurNVS在合成与真实模糊基准上均超越现有基线,在保持结构稳定性的同时生成更清晰的视觉效果,且避免了昂贵的逐场景优化。
原文摘要 · Abstract (English)
Novel view synthesis (NVS) is a fundamental problem in computer vision and graphics. Recent advances in neural radiance fields (NeRF), 3D Gaussian Splatting (3DGS), and generative view synthesis have substantially improved its quality. Yet most methods still rely on clean observations, where image structures and cross-view geometric cues are well preserved. Motion blur breaks this assumption by corrupting local details and weakening multi-view correspondences. Such blur commonly arises from camera shake, scene motion, or finite exposure in practical capture. Blur-aware NVS methods address this degradation by modeling image formation, but their reliance on costly per-scene optimization limits efficient and generalizable sparse-view synthesis. To address this, we propose DeblurNVS, a novel framework for synthesizing high-fidelity novel views directly from sparse motion-blurred images, without requiring per-scene optimization. DeblurNVS restores the intermediate geometric representations needed for multi-view reasoning, enabling blurred inputs to recover reliable structure and correspondence cues. The restored representations are then combined with target camera information to synthesize the target-view representation and reconstruct a sharp RGB novel view. To enable the large-scale training, we construct a motion-blurred NVS dataset from DL3DV-10K using interpolation-based finite-exposure blur synthesis. Extensive experiments demonstrate that DeblurNVS outperforms existing baselines on synthetic motion-blur benchmarks and generalizes to real motion-blurred scenes, producing perceptually sharper and structurally more stable novel views while avoiding costly per-scene optimization. Project page: https://github.com/PKU-YuanGroup/DeblurNVS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。