arXiv:2607.14990cs.CV2026-07

用事件相机信息联合优化模糊图像恢复,提升3D高斯溅射重建质量。

JADE-GS: Joint Allocation of Deblurring Evidence for Event-Assisted 3D Gaussian Splatting

论文配图:JADE-GS: Joint Allocation of Deblurring Evidence for Event-Assisted 3D Gaussian Splatting
图 1 · 摘自论文原文
  • 通过事件流与模糊图像联合建模,构建像素级修复证据分配机制
  • 在真实数据集上达到最佳保真度,感知质量领先双基准
  • 轻量级路由网络无需清晰参考图,训练开销远低于扩散模型

神经辐射场与3D高斯溅射假设每张训练图像为场景的清晰几何一致观测。运动模糊违反此假设,因单次曝光整合了连续的相机位姿。曝光积分也消除了恢复对应清晰图像所需的时序信息。事件相机以微秒级分辨率保留该信息,因此天然互补于传统图像。现有事件辅助重建方法主要通过解析反演事件双重积分获取图像监督。基于帧与事件的端到端学习恢复提供第二种先验,虽单独使用较弱,但可补足不同区域缺陷,形成互补证据。本文提出JADE-GS,将两种先验的组合形式化为空间证据分配。轻量级空间先验路由器仅利用模糊帧与事件流,预测像素级分配策略,并融合两个固定修复结果生成额外监督目标。路由器通过重建场景一致性与测量曝光进行无参考训练,优化后移除。实验表明,JADE-GS在两个基准上均达最优感知质量,在真实数据集上取得最佳保真度,合成数据集上仍具竞争力。其训练开销显著低于扩散基方法,且推理阶段保持原生3DGS渲染,无需生成解码。

原文摘要 · Abstract (English)

Neural radiance fields and 3D Gaussian Splatting assume that each training image is a sharp and geometrically consistent observation of the scene. Motion blur violates this assumption because a single exposure integrates a continuous range of camera poses. Exposure integration also removes the temporal information needed to recover the corresponding sharp observation. Event cameras preserve this information at microsecond resolution and therefore provide a natural complement to conventional images. Existing event-assisted reconstruction methods predominantly obtain image supervision through analytical inversion of the Event Double Integral. Learned restoration from frames and events offers a second prior. Although weaker when used alone, it fails in different regions and provides complementary evidence. We present JADE-GS, which formulates the combination of these priors as spatial evidence allocation. A lightweight Spatial Prior Router predicts a pixelwise allocation using only the blurry frame and event stream, then fuses the two fixed restorations into an additional supervision target. The router is trained without a sharp reference using consistency with the scene under reconstruction and the measured exposure, and is removed after optimization. Experiments show that JADE-GS achieves leading perceptual quality on both benchmarks, attains the best fidelity on the real benchmark, and remains competitive on the synthetic one. It requires substantially lower training overhead than diffusion-based alternatives and preserves native 3DGS rendering with no generative decoding at inference.

3D高斯事件相机去模糊多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。