arXiv:2508.14682cs.CV2025-08被引 1

直接从极严重运动模糊图像重建3D场景,无需清晰参考图。

GeMS: Efficient Gaussian Splatting for Extreme Motion Blur

  • 用深度学习的VGGSfM直接从模糊图估计相机位姿和点云。
  • 通过概率采样替代手工设定,实现鲁棒的3D高斯初始化。
  • 结合事件相机数据渐进优化,显著提升重建精度。

我们提出GeMS,一种针对极端运动模糊图像的3D高斯点阵(3DGS)框架。现有去模糊方法如ExBluRF及基于3DGS的方法(如Deblur-GS)通常依赖清晰图像进行位姿估计与点云生成,这一假设在极端模糊下不成立;依赖COLMAP初始化的方法(如BAD-Gaussians)也因模糊导致特征匹配不可靠而失效。为解决上述问题,GeMS可直接从严重模糊图像重建场景,其包含:(1) 基于深度学习的结构光流法(VGGSfM),直接从模糊输入估计位姿并生成点云;(2) 3DGS-MCMC,将高斯视为概率分布样本,消除手动稀疏化与修剪;(3) 联合优化相机轨迹与高斯参数以实现稳定重建。当所有输入均严重模糊时仍存误差,因此提出GeMS-E,引入事件相机数据进行渐进式精修:(4) 事件双积分(EDI)去模糊生成更清晰图像,再反馈至GeMS,提升位姿、点云及整体重建质量。在合成与真实数据集上,GeMS与GeMS-E均达到当前最优性能。据我们所知,这是首个直接从严重模糊输入处理3DGS中极端运动模糊的框架。

原文摘要 · Abstract (English)

We introduce GeMS, a framework for 3D Gaussian Splatting (3DGS) designed to handle severely motion-blurred images. State-of-the-art deblurring methods for extreme blur, such as ExBluRF, as well as Gaussian Splatting-based approaches like Deblur-GS, typically assume access to sharp images for camera pose estimation and point cloud generation, an unrealistic assumption. Methods relying on COLMAP initialization, such as BAD-Gaussians, also fail due to unreliable feature correspondences under severe blur. To address these challenges, we propose GeMS, a 3DGS framework that reconstructs scenes directly from extremely blurred images. GeMS integrates: (1) VGGSfM, a deep learning-based Structure-from-Motion pipeline that estimates poses and generates point clouds directly from blurred inputs; (2) 3DGS-MCMC, which enables robust scene initialization by treating Gaussians as samples from a probability distribution, eliminating heuristic densification and pruning; and (3) joint optimization of camera trajectories and Gaussian parameters for stable reconstruction. While this pipeline produces strong results, inaccuracies may remain when all inputs are severely blurred. To mitigate this, we propose GeMS-E, which integrates a progressive refinement step using events: (4) Event-based Double Integral (EDI) deblurring restores sharper images that are then fed into GeMS, improving pose estimation, point cloud generation, and overall reconstruction. Both GeMS and GeMS-E achieve state-of-the-art performance on synthetic and real-world datasets. To our knowledge, this is the first framework to address extreme motion blur within 3DGS directly from severely blurred inputs.

3D重建运动模糊事件相机高斯点阵

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。