用单次扫描事件相机实现宏微尺度高精度3D渲染
SweepEvGS: Event-Based 3D Gaussian Splatting for Macro and Micro Radiance Field Rendering from a Single Sweep
- 结合事件相机与3D高斯点云,单次移动完成场景重建
- 在宏/微观真实场景中均超越现有方法的画质与速度
- 适合动态环境下的快速高保真3D重建应用
3D高斯点云(3D-GS)技术已展现出从连续校准视角高速、高保真且低成本合成新视图的潜力。然而,传统方法需高帧率密集高质量清晰图像,采集耗时低效,尤其在动态环境中。事件相机具备高时间分辨率和异步亮度变化捕捉能力,为无运动模糊的可靠场景重建提供新路径。本文提出SweepEvGS,一种软硬件协同的新方法,利用事件相机在单次摄像头移动中捕获的初始静态帧与密集事件流,实现跨不同成像场景的鲁棒准确新视图合成。我们构建了多种真实世界硬件成像系统用于数据采集与评估,为未来研究提供基准。通过在三类成像设置下验证:合成物体、真实世界宏观级与微观级视图合成,结果表明SweepEvGS在视觉渲染质量、渲染速度和计算效率方面均优于现有方法,凸显其在动态实际应用中的潜力。
原文摘要 · Abstract (English)
Recent advancements in 3D Gaussian Splatting (3D-GS) have demonstrated the potential of using 3D Gaussian primitives for high-speed, high-fidelity, and cost-efficient novel view synthesis from continuously calibrated input views. However, conventional methods require high-frame-rate dense and high-quality sharp images, which are time-consuming and inefficient to capture, especially in dynamic environments. Event cameras, with their high temporal resolution and ability to capture asynchronous brightness changes, offer a promising alternative for more reliable scene reconstruction without motion blur. In this paper, we propose SweepEvGS, a novel hardware-integrated method that leverages event cameras for robust and accurate novel view synthesis across various imaging settings from a single sweep. SweepEvGS utilizes the initial static frame with dense event streams captured during a single camera sweep to effectively reconstruct detailed scene views. We also introduce different real-world hardware imaging systems for real-world data collection and evaluation for future research. We validate the robustness and efficiency of SweepEvGS through experiments in three different imaging settings: synthetic objects, real-world macro-level, and real-world micro-level view synthesis. Our results demonstrate that SweepEvGS surpasses existing methods in visual rendering quality, rendering speed, and computational efficiency, highlighting its potential for dynamic practical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。