针对遮挡成像中的噪声问题,提出自适应神经算子实现快速鲁棒重建。
Noise-adapted Neural Operator for Robust Non-Line-of-Sight Imaging
- 通过噪声估计模块动态感知数据噪声水平,指导重建过程。
- 基于算子学习的深度算法展开框架,实现端到端快速3D图像重建。
- 融合全局与局部时空特征,提升复杂场景下的成像精度与鲁棒性。
计算成像,尤其是非视距(NLOS)成像,通过利用多次反射或散射的间接光信号来提取被遮挡场景的信息。由于这些信号本身极其微弱且易受噪声干扰,必须结合物理过程以确保重建准确。本文提出一种专为大规模线性3D成像逆问题设计的参数化反问题框架。首先,采用噪声估计模块自适应评估瞬态数据中的噪声水平;随后,设计参数化神经算子近似逆映射,实现端到端快速图像重建。所提出的3D重建框架基于算子学习,通过深度算法展开构建,不仅具备良好模型可解释性,还能动态适应不同噪声水平,从而保证一致的高精度与鲁棒性。此外,提出一种新型全局与局部时空特征融合方法,整合结构与细节信息,显著提升重建精度与鲁棒性。在模拟与真实数据集上的大量实验验证了该方法的有效性,在快速扫描与稀疏照明点条件下表现优异,为复杂场景下的NLOS成像提供了可行解决方案。
原文摘要 · Abstract (English)
This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Computational imaging, especially non-line-of-sight (NLOS) imaging, the extraction of information from obscured or hidden scenes is achieved through the utilization of indirect light signals resulting from multiple reflections or scattering. The inherently weak nature of these signals, coupled with their susceptibility to noise, necessitates the integration of physical processes to ensure accurate reconstruction. This paper presents a parameterized inverse problem framework tailored for large-scale linear problems in 3D imaging reconstruction. Initially, a noise estimation module is employed to adaptively assess the noise levels present in transient data. Subsequently, a parameterized neural operator is developed to approximate the inverse mapping, facilitating end-to-end rapid image reconstruction. Our 3D image reconstruction framework, grounded in operator learning, is constructed through deep algorithm unfolding, which not only provides commendable model interpretability but also enables dynamic adaptation to varying noise levels in the acquired data, thereby ensuring consistently robust and accurate reconstruction outcomes. Furthermore, we introduce a novel method for the fusion of global and local spatiotemporal data features. By integrating structural and detailed information, this method significantly enhances both accuracy and robustness. Comprehensive numerical experiments conducted on both simulated and real datasets substantiate the efficacy of the proposed method. It demonstrates remarkable performance with fast scanning data and sparse illumination point data, offering a viable solution for NLOS imaging in complex scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。