arXiv:2412.09427eess.IVcs.CV2024-12被引 1

用插件式算法提升单光子雷达的3D视频超分辨率,解决运动模糊和低分辨率问题。

A Plug-and-Play Algorithm for 3D Video Super-Resolution of Single-Photon LiDAR data

  • 通过交替优化超分辨率与光流对齐,实现动态场景的精准重建。
  • 在不同信噪比和光子水平下,图像分辨率显著提升。
  • 适用于实验室、消费级传感器及户外远距离实测,效果稳定可靠。

单光子雪崩二极管(SPAD)能以皮秒级精度探测单个光子并记录到达时间,用于激光雷达等应用,可捕捉高速序列的二值单光子图像,具备高动态三维环境重建潜力。通常与低帧率的高分辨率(HR)强度相机配合使用。但基于SPAD数据的3D重建面临挑战:多帧累积虽可降噪提精度,却易导致动态场景运动模糊;且SPAD阵列空间分辨率常低于普通相机。为此,本文提出一种新型计算成像算法,通过插件式优化框架,在引导视频超分辨率与光学流精确对齐之间交替迭代,有效缓解运动模糊并提升原始空间分辨率。合成数据实验表明,该方法在多种信噪比和光子水平下均显著提升图像质量。真实世界测试涵盖三种典型场景:实验室短距快速运动场景;消费级STMicroelectronics SPAD传感器下的极低分辨率人体成像;以及使用短波红外SPAD相机,在325米远距离、日光光照与眼安全照明条件下对行走人群的高清成像。结果验证了方法的鲁棒性与普适性。

原文摘要 · Abstract (English)

Single-photon avalanche diodes (SPADs) are advanced sensors capable of detecting individual photons and recording their arrival times with picosecond resolution using time-correlated Single-Photon Counting detection techniques. They are used in various applications, such as LiDAR, and can capture high-speed sequences of binary single-photon images, offering great potential for reconstructing 3D environments with high motion dynamics. To complement single-photon data, they are often paired with conventional passive cameras, which capture high-resolution (HR) intensity images at a lower frame rate. However, 3D reconstruction from SPAD data faces challenges. Aggregating multiple binary measurements improves precision and reduces noise but can cause motion blur in dynamic scenes. Additionally, SPAD arrays often have lower resolution than passive cameras. To address these issues, we propose a novel computational imaging algorithm to improve the 3D reconstruction of moving scenes from SPAD data by addressing the motion blur and increasing the native spatial resolution. We adopt a plug-and-play approach within an optimization scheme alternating between guided video super-resolution of the 3D scene, and precise image realignment using optical flow. Experiments on synthetic data show significantly improved image resolutions across various signal-to-noise ratios and photon levels. We validate our method using real-world SPAD measurements on three practical situations with dynamic objects. First on fast-moving scenes in laboratory conditions at short range; second very low resolution imaging of people with a consumer-grade SPAD sensor from STMicroelectronics; and finally, HR imaging of people walking outdoors in daylight at a range of 325 meters under eye-safe illumination conditions using a short-wave infrared SPAD camera. These results demonstrate the robustness and versatility of our approach.

3D重建单光子超分辨率LiDAR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。