arXiv:2412.10300physics.opticscs.CV2024-12被引 1

通过迭代全量光传输矩阵,实现从拐角处看到隐藏物体的多种新功能。

Iterating the Transient Light Transport Matrix for Non-Line-of-Sight Imaging

  • 利用全量光传输矩阵,计算生成二次光路信息以实现拐角成像
  • 首次在实验中实现对隐藏场景的重照明、直接/间接光分离与双摄影
  • 使用高速单光子探测阵列,大幅缩短采集时间,适合实时应用

主动成像系统通过可控光源依次照射场景各位置,并用飞行时间(ToF)传感器测量其时空光传输特性,构建瞬态光传输矩阵(TLTM)。非线性视线(NLOS)成像利用该系统测量中介反射面的部分TLTM,通过解析其中编码的间接光信号来“绕过障碍物观察”。现有系统通常仅采集部分TLTM,而新型定制化门控单光子雪崩二极管(SPAD)阵列已使完整测量成为可能。本文展示可通过高效算法处理完整的TLTM,实现对隐藏场景不同区域的计算聚焦与照明检测,将反射面变为二级主动成像系统。这些算法可迭代原始的一阶TLTM,提取出隐藏场景表面的二阶TLTM。我们展示了三种应用:(1)新光照下的场景重照明;(2)隐藏场景中直接与间接光成分的分离;(3)双摄影。此外,实验证明SPAD阵列支持并行光子采集,显著降低采集时间。

原文摘要 · Abstract (English)

Active imaging systems sample the Transient Light Transport Matrix (TLTM) for a scene by sequentially illuminating various positions in this scene using a controllable light source, and then measuring the resulting spatiotemporal light transport with time of flight (ToF) sensors. Time-resolved Non-line-of-sight (NLOS) imaging employs an active imaging system that measures part of the TLTM of an intermediary relay surface, and uses the indirect reflections of light encoded within this TLTM to "see around corners". Such imaging systems have applications in diverse areas such as disaster response, remote surveillance, and autonomous navigation. While existing NLOS imaging systems usually measure a subset of the full TLTM, development of customized gated Single Photon Avalanche Diode (SPAD) arrays \cite{riccardo_fast-gated_2022} has made it feasible to probe the full measurement space. In this work, we demonstrate that the full TLTM on the relay surface can be processed with efficient algorithms to computationally focus and detect our illumination in different parts of the hidden scene, turning the relay surface into a second-order active imaging system. These algorithms allow us to iterate on the measured, first-order TLTM, and extract a \textbf{second order TLTM for surfaces in the hidden scene}. We showcase three applications of TLTMs in NLOS imaging: (1) Scene Relighting with novel illumination, (2) Separation of direct and indirect components of light transport in the hidden scene, and (3) Dual Photography. Additionally, we empirically demonstrate that SPAD arrays enable parallel acquisition of photons, effectively mitigating long acquisition times.

非线性视线成像光传输矩阵单光子探测重照明

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。