将编码透镜置于光圈外,提升大视场彩色深度成像质量。
Learned Off-aperture Encoding for Wide Field-of-view RGBD Imaging
- 在光圈外设置衍射光学元件,实现波前局部调控。
- 45度视场下图像质量提升超5分贝(PSNR),优于传统设计。
- 适用于简单镜头与复杂光学系统,适合高精度成像应用。
端到端设计的成像系统通过编码光学与解码算法结合提升成像质量,但现有方法在大视场下受限于高计算复杂度及难以建模离轴波传播和像差。传统将编码元件置于光圈或孔径平面仅能全局控制波前。本文提出将衍射光学元件(DOE)置于光圈外,实现自由度的空间解耦,提供对图像平面波前的局部控制。该方法结合可微分的光线与波动光学建模,优化深度成像质量并验证系统通用性。实验表明,在约45°视场下,搭配单薄透镜时,成像质量提升超过5 dB(PSNR);使用复合光学系统,在近28°视场成功恢复彩色与深度信息。物理原型验证了该方法的有效性与灵活性。
原文摘要 · Abstract (English)
End-to-end (E2E) designed imaging systems integrate coded optical designs with decoding algorithms to enhance imaging fidelity for diverse visual tasks. However, existing E2E designs encounter significant challenges in maintaining high image fidelity at wide fields of view, due to high computational complexity, as well as difficulties in modeling off-axis wave propagation while accounting for off-axis aberrations. In particular, the common approach of placing the encoding element into the aperture or pupil plane results in only a global control of the wavefront. To overcome these limitations, this work explores an additional design choice by positioning a DOE off-aperture, enabling a spatial unmixing of the degrees of freedom and providing local control over the wavefront over the image plane. Our approach further leverages hybrid refractive-diffractive optical systems by linking differentiable ray and wave optics modeling, thereby optimizing depth imaging quality and demonstrating system versatility. Experimental results reveal that the off-aperture DOE enhances the imaging quality by over 5 dB in PSNR at a FoV of approximately $45^\circ$ when paired with a simple thin lens, outperforming traditional on-aperture systems. Furthermore, we successfully recover color and depth information at nearly $28^\circ$ FoV using off-aperture DOE configurations with compound optics. Physical prototypes for both applications validate the effectiveness and versatility of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。