arXiv:2605.07192cs.CV2026-05被引 1

用事件相机提升手机拍摄模糊场景的3D重建质量

AsyncEvGS: Asynchronous Event-Assisted Gaussian Splatting for Handheld Motion-Blurred Scenes

论文配图:AsyncEvGS: Asynchronous Event-Assisted Gaussian Splatting for Handheld Motion-Blurred Scenes
图 1 · 摘自论文原文
  • 异步双摄系统融合高分辨率事件数据与图像,避免同步限制
  • 通过事件流重建清晰图像,结合跨域位姿估计提升初始化精度
  • 新设计的损失函数有效抑制模糊重建中的不稳定问题

3D高斯点阵(3DGS)和神经辐射场(NeRF)等三维重建方法虽能实现逼真效果,但在输入图像严重运动模糊时表现不佳。事件相机虽可提供高时间分辨率的运动信息,但现有事件辅助方法依赖低分辨率传感器且需严格同步,难以在智能手机等手持设备上应用。本文提出一种灵活、高分辨率的异步RGB-事件双摄系统及对应重建框架。首先利用事件数据重建清晰图像,再通过基于视觉几何变换器(VGGT)的跨域位姿估计模块获得3DGS的鲁棒初始值。优化阶段引入结构驱动事件损失与视图特定一致性正则项,缓解传统事件损失和去模糊损失的病态性,确保重建稳定且保真度高。我们还构建了新的高分辨率异步数据集AsyncEv-Deblur。实验表明,该方法在自建挑战性数据集和现有基准上均达到最先进性能,显著提升严重运动模糊下的重建鲁棒性。

原文摘要 · Abstract (English)

3D reconstruction methods such as 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) achieve impressive photorealism but fail when input images suffer from severe motion blur. While event cameras provide high-temporal-resolution motion cues, existing event-assisted approaches rely on low-resolution sensors and strict synchronization, limiting their practicality for handheld 3D capture on common devices, such as smartphones. We introduce a flexible, high-resolution asynchronous RGB-Event dual-camera system and a corresponding reconstruction framework. Our approach first reconstructs sharp images from the event data and then employs a cross-domain pose estimation module based on the Visual Geometry Transformer (VGGT) to obtain robust initialization for 3DGS. During optimization, we employ a structure-driven event loss and view-specific consistency regularizers to mitigate the ill-posed behavior of traditional event losses and deblurring losses, ensuring both stable and high-fidelity reconstruction. We further contribute AsyncEv-Deblur, a new high-resolution RGB-Event dataset captured with our asynchronous system. Experiments demonstrate that our method achieves state-of-the-art performance on both our challenging dataset and existing benchmarks, substantially improving reconstruction robustness under severe motion blur. Project page: https://openimaginglab.github.io/AsyncEvGS/

3D重建事件相机去模糊异步系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。