用连续运动建模解决运动模糊下的3D高精度重建问题
CoMoGaussian: Continuous Motion-Aware Gaussian Splatting from Motion-Blurred Images
- 用神经ODE预测连续相机轨迹,提升运动模糊下的建模精度
- 在多个基准数据集上实现领先性能,极端模糊场景下仍保持高保真
- 适合需要真实世界动态场景重建的研究者与工业应用
3D Gaussian Splatting(3DGS)因其高质量的新视角渲染而受到广泛关注,推动了对现实世界挑战的研究。一个关键问题是拍摄期间因相机运动产生的运动模糊,阻碍了精确的3D场景重建。本文提出CoMoGaussian,一种连续运动感知的3DGS方法,可在保持实时渲染速度的同时,从运动模糊图像中重建精准3D场景。考虑到真实世界相机运动的复杂性,我们使用神经常微分方程(neural ODEs)预测连续相机轨迹。为确保建模准确,采用刚体变换,保持物体形状与大小,但依赖采样帧的离散积分。为进一步逼近运动模糊的连续特性,引入连续运动精炼(CMR)变换,通过可学习参数优化刚体变换。通过重新审视基本相机理论并结合先进的神经ODE技术,实现了连续相机轨迹的精确建模,显著提升重建精度。大量实验表明,在涵盖中度到极端模糊场景的基准数据集上,该方法在定量与定性指标上均达到领先水平。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has gained significant attention due to its high-quality novel view rendering, motivating research to address real-world challenges. A critical issue is the camera motion blur caused by movement during exposure, which hinders accurate 3D scene reconstruction. In this study, we propose CoMoGaussian, a Continuous Motion-Aware Gaussian Splatting that reconstructs precise 3D scenes from motion-blurred images while maintaining real-time rendering speed. Considering the complex motion patterns inherent in real-world camera movements, we predict continuous camera trajectories using neural ordinary differential equations (ODEs). To ensure accurate modeling, we employ rigid body transformations, preserving the shape and size of the object but rely on the discrete integration of sampled frames. To better approximate the continuous nature of motion blur, we introduce a continuous motion refinement (CMR) transformation that refines rigid transformations by incorporating additional learnable parameters. By revisiting fundamental camera theory and leveraging advanced neural ODE techniques, we achieve precise modeling of continuous camera trajectories, leading to improved reconstruction accuracy. Extensive experiments demonstrate state-of-the-art performance both quantitatively and qualitatively on benchmark datasets, which include a wide range of motion blur scenarios, from moderate to extreme blur.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。