解决单光子相机高光通量下的失真问题,实现高精度3D成像。
High-Flux Count-Free Single-Photon 3D Cameras

- 采用自由运行采集+合成分析的计算成像方法
- 在宽光照条件下稳定还原场景深度与反射率
- 适合带宽受限的高分辨率单光子相机应用
基于单光子雪崩二极管(SPAD)技术的单光子相机因其极高灵敏度和时间分辨率,在3D感知中日益流行。但其广泛应用受限于两大挑战:(i) 高光通量下出现非线性失真,称为“堆叠效应”;(ii) 产生大量原始光子数据,造成每个像素严重的数据瓶颈。本文指出,尽管压缩感知技术缓解了数据传输压力,却加剧了死时间失真,因无法保留足够的光子探测历史信息以支持现有方法进行事后堆叠校正。为此,我们提出一种新计算成像方法,结合自由运行采集与分析-合成软件流程,有效缓解堆叠失真。硬件模拟及全场景、单像素仿真结果表明,该方法可在多种光照条件下可靠还原场景距离与反射率。本工作使严重带宽受限的高分辨率SPAD相机能够在真实高光通量场景中运行。
原文摘要 · Abstract (English)
Single-photon cameras based on single-photon avalanche diode (SPAD) technology are gaining popularity for 3D sensing, thanks to their extreme sensitivity and time resolution. There are two key challenges with single-photon cameras that limit their widespread use: (i) they suffer from non-linear distortions called ''pile-up'' when operated in high-photon-flux conditions, and (ii) they generate a large volume of raw photon data, creating a severe data bottleneck at each sensor pixel. In this work, we show that while compressive capture techniques successfully mitigate data transfer challenges, they exacerbate the effects of dead-time distortion because they fail to retain sufficient information about the photon detection history to allow post-processing pile-up correction via existing methods. We propose a new computational-imaging method that combines free-running capture with an analysis-by-synthesis software pipeline to mitigate pile-up distortions. Our results with hardware emulations and full-scene and single-pixel simulations show that our method can reliably capture scene distance and reflectance over a wide range of illumination conditions. Our work will enable high-resolution SPAD cameras that are severely bandwidth-constrained to operate in real-world high-flux scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。