解决手持相机拍摄动态场景时的模糊问题,提升3D重建质量。
BARD-GS: Blur-Aware Reconstruction of Dynamic Scenes via Gaussian Splatting
- 分离相机与物体运动模糊,分别建模处理
- 在真实模糊数据集上显著优于现有方法
- 适合手持设备拍摄的动态场景重建
3D Gaussian Splatting(3DGS)在静态场景重建中表现出色,近年已拓展至动态场景。然而,重建质量高度依赖高质量输入图像和精确相机位姿,这在真实场景中难以实现。例如,使用手持单目相机捕捉动态场景时,相机与物体在单次曝光内同时运动,导致图像模糊,现有方法难以应对。为此,我们提出BARD-GS,一种鲁棒的动态场景重建方法,能有效处理模糊输入与不精确相机位姿。该方法包含两个核心组件:1)相机运动去模糊;2)物体运动去模糊。通过显式分解运动模糊为相机运动模糊与物体运动模糊,并分别建模,显著提升了动态区域的渲染效果。此外,我们构建了一个真实世界动态场景运动模糊数据集用于评估。大量实验表明,BARD-GS在真实条件下能有效重建高质量动态场景,显著优于现有方法。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has shown remarkable potential for static scene reconstruction, and recent advancements have extended its application to dynamic scenes. However, the quality of reconstructions depends heavily on high-quality input images and precise camera poses, which are not that trivial to fulfill in real-world scenarios. Capturing dynamic scenes with handheld monocular cameras, for instance, typically involves simultaneous movement of both the camera and objects within a single exposure. This combined motion frequently results in image blur that existing methods cannot adequately handle. To address these challenges, we introduce BARD-GS, a novel approach for robust dynamic scene reconstruction that effectively handles blurry inputs and imprecise camera poses. Our method comprises two main components: 1) camera motion deblurring and 2) object motion deblurring. By explicitly decomposing motion blur into camera motion blur and object motion blur and modeling them separately, we achieve significantly improved rendering results in dynamic regions. In addition, we collect a real-world motion blur dataset of dynamic scenes to evaluate our approach. Extensive experiments demonstrate that BARD-GS effectively reconstructs high-quality dynamic scenes under realistic conditions, significantly outperforming existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。