用事件相机实现无需姿态信息的高质量3D重建
E2EGS: Event-to-Edge Gaussian Splatting for Pose-Free 3D Reconstruction
- 从事件流中提取边缘信息,替代传统姿态依赖
- 在真实数据上达到优于现有方法的重建精度和轨迹准确率
- 适合动态场景下无姿态约束的3D重建任务
神经辐射场(NeRF)和3D高斯点阵(3DGS)推动了新视角合成(NVS)的发展,但其依赖高质量图像和精确相机姿态,在快速运动或恶劣光照下表现受限。事件相机以高时间分辨率和宽动态范围捕捉像素亮度变化,能有效感知动态场景。然而,现有基于事件的NVS方法要么假设已知姿态,要么依赖初始观测受限的深度估计模型,难以泛化到未见区域。本文提出E2EGS,一种仅依赖事件流的无姿态框架。核心思想是:边缘信息蕴含丰富结构线索,可辅助轨迹估计与高质量重建。通过分析事件流的时空特性——边缘处事件具有一致性,非边缘区域为稀疏噪声——采用基于块的时序一致性分析,测量局部方差以提取边缘并抑制噪声。提取的边缘指导结构感知的高斯初始化,并在初始化、追踪及束调整中引入边缘加权损失。大量合成与真实数据实验表明,E2EGS在重建质量和轨迹精度上均优于现有方法,确立了事件相机驱动的全无姿态3D重建范式。
原文摘要 · Abstract (English)
The emergence of neural radiance fields (NeRF) and 3D Gaussian splatting (3DGS) has advanced novel view synthesis (NVS). These methods, however, require high-quality RGB inputs and accurate corresponding poses, limiting robustness under real-world conditions such as fast camera motion or adverse lighting. Event cameras, which capture brightness changes at each pixel with high temporal resolution and wide dynamic range, enable precise sensing of dynamic scenes and offer a promising solution. However, existing event-based NVS methods either assume known poses or rely on depth estimation models that are bounded by their initial observations, failing to generalize as the camera traverses previously unseen regions. We present E2EGS, a pose-free framework operating solely on event streams. Our key insight is that edge information provides rich structural cues essential for accurate trajectory estimation and high-quality NVS. To extract edges from noisy event streams, we exploit the distinct spatio-temporal characteristics of edges and non-edge regions. The event camera's movement induces consistent events along edges, while non-edge regions produce sparse noise. We leverage this through a patch-based temporal coherence analysis that measures local variance to extract edges while robustly suppressing noise. The extracted edges guide structure-aware Gaussian initialization and enable edge-weighted losses throughout initialization, tracking, and bundle adjustment. Extensive experiments on both synthetic and real datasets demonstrate that E2EGS achieves superior reconstruction quality and trajectory accuracy, establishing a fully pose-free paradigm for event-based 3D reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。