arXiv:2511.18037cs.CV2025-11

首个统一噪声模型,解析混合传感器的噪声机制

Hybrid Event Frame Sensors: Modeling, Calibration, and Simulation

  • 基于统计建模,联合刻画APS与EVS的噪声特性
  • 实测数据校准参数,揭示光照与暗电流对事件噪声的影响
  • 支持真实感仿真,适用于视觉任务迁移验证

混合事件-帧传感器(Hybrid Event-Frame Sensor)将事件视觉传感器(EVS)与自驱动像素传感器(APS)集成于单芯片,结合EVS的高动态范围与低延迟优势及APS的空间强度信息。然而,复杂电路引入了尚未被充分理解的噪声模式。本文首次提出统一的统计成像噪声模型,联合描述APS与EVS像素的噪声行为,明确包含光子散粒噪声、暗电流噪声、固定图案噪声和量化噪声,并建立事件噪声与光照水平及暗电流的关联。基于此模型,构建校准流程以从真实数据中估计噪声参数,并详细分析两类传感器的噪声表现。进一步提出H-ESIM模拟器,可生成符合联合校准噪声统计的原始帧与事件数据。在两个混合传感器上的实验验证了模型在视频插值与去模糊等任务中的有效性,显示仿真到真实数据的良好迁移能力。

原文摘要 · Abstract (English)

Hybrid event-frame sensors integrate an Event Vision Sensor (EVS) and an Active Pixel Sensor (APS) within a single chip, combining the high dynamic range and low latency of the EVS with the rich spatial intensity information from the APS. While this tight integration offers compact and temporally precise imaging, the complex circuit architecture introduces nontrivial noise patterns that remain poorly understood and unmodeled. In this work, we present the first unified statistics-based imaging noise model that jointly describes the noise behavior of APS and EVS pixels. Our formulation explicitly incorporates photon shot noise, dark current noise, fixed-pattern noise, and quantization noise, and links EVS noise to illumination level and dark current. Based on this formulation, we further develop a calibration pipeline to estimate noise parameters from real data and provide a detailed analysis of both APS and EVS noise behaviors. Finally, we propose H-ESIM, a statistically grounded simulator that generates RAW frames and events under realistic jointly calibrated noise statistics. Experiments on two hybrid sensors validate our model across multiple imaging tasks, including video frame interpolation and deblurring, demonstrating strong transfer from simulation to real data.

传感器融合事件视觉噪声建模仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。