针对单光子3D相机硬件限制,设计更优编码函数以提升成像性能。
Hardware-aware Coding Function Design for Compressive Single-Photon 3D Cameras
- 基于梯度下降联合优化光照与编码矩阵,满足硬件约束。
- 在带宽和峰值功率受限下,性能显著优于传统编码设计。
- 可适配真实系统中的非理想脉冲响应,适合实际部署。
单光子相机因其极高的时间分辨率,在飞行时间3D成像中日益流行。然而,其性能易受系统带宽、激光峰值功率、传感器数据率及片上内存与计算资源等硬件限制影响。压缩直方图被提出用于在线压缩光子时间戳数据,缓解数据率压力,但在真实光照硬件约束下表现不佳。为此,本文提出一种硬件感知的编码函数设计方法,通过梯度下降联合优化照明与编码矩阵,确保符合实际硬件限制。大量仿真表明,该方法在带宽和峰值功率约束下均显著优于传统编码方案,尤其在峰值功率受限系统中优势明显。此外,该方法可适应任意参数化脉冲响应,在真实系统上验证了其有效性。
原文摘要 · Abstract (English)
Single-photon cameras are becoming increasingly popular in time-of-flight 3D imaging because they can time-tag individual photons with extreme resolution. However, their performance is susceptible to hardware limitations, such as system bandwidth, maximum laser power, sensor data rates, and in-sensor memory and compute resources. Compressive histograms were recently introduced as a solution to the challenge of data rates through an online in-sensor compression of photon timestamp data. Although compressive histograms work within limited in-sensor memory and computational resources, they underperform when subjected to real-world illumination hardware constraints. To address this, we present a constrained optimization approach for designing practical coding functions for compressive single-photon 3D imaging. Using gradient descent, we jointly optimize an illumination and coding matrix (i.e., the coding functions) that adheres to hardware constraints. We show through extensive simulations that our coding functions consistently outperform traditional coding designs under both bandwidth and peak power constraints. This advantage is particularly pronounced in systems constrained by peak power. Finally, we show that our approach adapts to arbitrary parameterized impulse responses by evaluating it on a real-world system with a non-ideal impulse response function.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。