用深度学习修复散射中的图像,实现无暗角高清成像。
Hybrid Deep Reconstruction for Vignetting-Free Upconversion Imaging through Scattering in ENZ Materials
- 结合监督与自监督学习,分两阶段重建散射光信号。
- 相比原始数据,平均PSNR提升124%,IoU提高10倍。
- 适合生物成像等强散射环境下的高精度成像需求。
通过浑浊或非均质介质(统称复杂介质)的光学成像受散射严重干扰,导致空间和相位信息混乱。为解决此问题,我们提出一种混合监督的深度学习框架,利用时间门控ε近零(ENZ)成像系统获取非线性散射测量数据,并基于亚波长氧化铟锡(ITO)薄膜中的四波混频(FWM)技术,实现对弹道光子的时序分离,有效抑制多散射光并提升对比度。为从这些信号中恢复结构特征,引入DeepTimeGate模型——基于U-Net的监督重建模块,随后通过深度图像先验(DIP)进行自监督优化。该方法在二值分辨率图案与复杂涡旋相位掩模下均表现优异,不同散射条件下平均PSNR提升124%,SSIM提升231%,交并比(IoU)提高10倍。此外,该方法消除了伪影引起的暗角效应,扩展了有效视场,显著优于传统ENZ时间门输出。结果表明其在生物医学成像、溶液内诊断等常规光学成像失效场景中具有广泛应用潜力。
原文摘要 · Abstract (English)
Optical imaging through turbid or heterogeneous environments (collectively referred to as complex media) is fundamentally challenged by scattering, which scrambles structured spatial and phase information. To address this, we propose a hybrid-supervised deep learning framework to reconstruct high-fidelity images from nonlinear scattering measurements acquired with a time-gated epsilon-near-zero (ENZ) imaging system. The system leverages four-wave mixing (FWM) in subwavelength indium tin oxide (ITO) films to temporally isolate ballistic photons, thus rejecting multiply scattered light and enhancing contrast. To recover structured features from these signals, we introduce DeepTimeGate, a U-Net-based supervised model that performs initial reconstruction, followed by a Deep Image Prior (DIP) refinement stage using self-supervised learning. Our approach demonstrates strong performance across different imaging scenarios, including binary resolution patterns and complex vortex-phase masks, under varied scattering conditions. Compared to raw scattering inputs, it boosts average PSNR by 124%, SSIM by 231%, and achieves a 10 times improvement in intersection-over-union (IoU). Beyond enhancing fidelity, our method removes the vignetting effect and expands the effective field-of-view compared to the ENZ-based optical time gate output. These results suggest broad applicability in biomedical imaging, in-solution diagnostics, and other scenarios where conventional optical imaging fails due to scattering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。