arXiv:2508.18071cs.CV2025-08被引 1

用快速路径追踪生成高保真事件流,模拟真实传感器数据。

EventTracer: Fast Path Tracing-based Event Stream Rendering

  • 低采样路径追踪加速渲染,结合轻量脉冲网络去噪。
  • 每秒720p视频仅需4分钟,支持1000+ FPS高时序分辨率。
  • 适合机器人、自动驾驶等需要高精度事件数据的场景。

从3D场景中模拟事件流已成为事件视觉研究的常见做法,可在无需昂贵硬件或大规模采集的情况下获得大规模、高时间频率的数据。然而现有方法多基于无噪声的RGB帧,渲染成本高,仅能实现100-300 FPS的时序分辨率,远低于真实事件数据。本文提出EventTracer,一种基于路径追踪的渲染管线,可高效且物理感知地从复杂3D场景生成高保真事件序列。通过低样本/像素(SPP)路径追踪加速渲染,并训练一个轻量级事件脉冲网络,将结果RGB视频去噪为真实事件序列。网络采用双极漏电积分-放电(BiLIF)脉冲单元,并以双向地球移动距离(EMD)损失进行训练。该管道每秒720p视频仅需约4分钟,继承了路径追踪在时空建模上的准确性。实验表明,它在两项下游任务中比其他模拟器更精确捕捉场景细节,与真实事件数据更相似,是低成本构建大规模事件-RGB数据集的有力工具,有助于缩小事件视觉中的仿真到现实差距,推动机器人、自动驾驶及VRAR等应用发展。

原文摘要 · Abstract (English)

Simulating event streams from 3D scenes has become a common practice in event-based vision research, as it meets the demand for large-scale, high temporal frequency data without setting up expensive hardware devices or undertaking extensive data collections. Yet existing methods in this direction typically work with noiseless RGB frames that are costly to render, and therefore they can only achieve a temporal resolution equivalent to 100-300 FPS, far lower than that of real-world event data. In this work, we propose EventTracer, a path tracing-based rendering pipeline that simulates high-fidelity event sequences from complex 3D scenes in an efficient and physics-aware manner. Specifically, we speed up the rendering process via low sample-per-pixel (SPP) path tracing, and train a lightweight event spiking network to denoise the resulting RGB videos into realistic event sequences. To capture the physical properties of event streams, the network is equipped with a bipolar leaky integrate-and-fired (BiLIF) spiking unit and trained with a bidirectional earth mover distance (EMD) loss. Our EventTracer pipeline runs at a speed of about 4 minutes per second of 720p video, and it inherits the merit of accurate spatiotemporal modeling from its path tracing backbone. We show in two downstream tasks that EventTracer captures better scene details and demonstrates a greater similarity to real-world event data than other event simulators, which establishes it as a promising tool for creating large-scale event-RGB datasets at a low cost, narrowing the sim-to-real gap in event-based vision, and boosting various application scenarios such as robotics, autonomous driving, and VRAR.

事件视觉路径追踪仿真生成实时渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。