arXiv:2504.16389cs.CV2025-04中稿 · IJCNN 2025被引 2

用事件流实现无伪影的高保真3D场景重建

SaENeRF: Suppressing Artifacts in Event-based Neural Radiance Fields

  • 基于事件极性累积,动态归一化辐射度变化,促进快速学习
  • 引入特定正则化损失,有效抑制低于阈值区域的伪影
  • 适合静态场景下高精度3D重建,尤其适用于高速视觉任务

事件相机是类脑视觉传感器,能异步捕捉对数亮度变化,具备低延迟、低功耗、低带宽和高动态范围等优势,非常适合高速场景。然而,从事件数据中重建几何一致且光度准确的3D表示仍面临根本挑战。现有事件神经辐射场(NeRF)方法虽部分缓解问题,但仍受早期网络过激学习及事件相机固有噪声影响,导致持续出现伪影。为此,我们提出SaENeRF,一种新颖的自监督框架,仅依赖事件流即可实现静态场景的3D一致、稠密且逼真的NeRF重建。该方法基于累积事件极性归一化预测的辐射度变化,促进渐进式快速学习。此外,设计了专门的正则化损失,在事件变化低于阈值区域抑制伪影的同时增强非零事件的光照差异,显著提升重建视觉质量。大量定性和定量实验表明,本方法显著减少伪影,重建效果优于现有方法。

原文摘要 · Abstract (English)

Event cameras are neuromorphic vision sensors that asynchronously capture changes in logarithmic brightness changes, offering significant advantages such as low latency, low power consumption, low bandwidth, and high dynamic range. While these characteristics make them ideal for high-speed scenarios, reconstructing geometrically consistent and photometrically accurate 3D representations from event data remains fundamentally challenging. Current event-based Neural Radiance Fields (NeRF) methods partially address these challenges but suffer from persistent artifacts caused by aggressive network learning in early stages and the inherent noise of event cameras. To overcome these limitations, we present SaENeRF, a novel self-supervised framework that effectively suppresses artifacts and enables 3D-consistent, dense, and photorealistic NeRF reconstruction of static scenes solely from event streams. Our approach normalizes predicted radiance variations based on accumulated event polarities, facilitating progressive and rapid learning for scene representation construction. Additionally, we introduce regularization losses specifically designed to suppress artifacts in regions where photometric changes fall below the event threshold and simultaneously enhance the light intensity difference of non-zero events, thereby improving the visual fidelity of the reconstructed scene. Extensive qualitative and quantitative experiments demonstrate that our method significantly reduces artifacts and achieves superior reconstruction quality compared to existing methods. The code is available at https://github.com/Mr-firework/SaENeRF.

事件相机神经辐射场3D重建自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。