arXiv:2412.09774cs.CV2024-12ICCV被引 10

提出可微分波光学模型,实现光学与算法联合优化。

A Differentiable Wave Optics Model for End-to-End Computational Imaging System Optimization

  • 构建可微分波光学模拟器,同时建模像差与衍射效应。
  • 联合优化后系统在测试中表现更优,忽略波光学则性能下降。
  • 适合需高鲁棒性成像系统的研究人员参考。

端到端优化通过反向传播联合优化光学与算法,已成为计算成像系统设计的有力方法。该方法依赖可微分光学模拟器生成测量数据,并通过算法从测量中提取信息。然而,由于计算成本高,现有方法难以在复合光学系统中同时建模像差和衍射。因此,多数方法为降低复杂度而忽略波光学效应或离轴像差,影响设计鲁棒性。本文提出一种高效的可微分光学模拟器,能同时建模复合光学中的像差与衍射。利用该模拟器,我们在场景重建与分类任务中进行端到端优化。实验表明,是否建模波光学会影响镜头与算法的最终配置;未建模波光学的系统在引入真实波光学效应后性能显著下降。结果强调了准确建模波光学对实现高性能、鲁棒成像系统的重要性。

原文摘要 · Abstract (English)

End-to-end optimization, which simultaneously optimizes optics and algorithms, has emerged as a powerful data-driven method for computational imaging system design. This method achieves joint optimization through backpropagation by incorporating differentiable optics simulators to generate measurements and algorithms to extract information from measurements. However, due to high computational costs, it is challenging to model both aberration and diffraction in light transport for end-to-end optimization of compound optics. Therefore, most existing methods compromise physical accuracy by neglecting wave optics effects or off-axis aberrations, which raises concerns about the robustness of the resulting designs. In this paper, we propose a differentiable optics simulator that efficiently models both aberration and diffraction for compound optics. Using the simulator, we conduct end-to-end optimization on scene reconstruction and classification. Experimental results demonstrate that both lenses and algorithms adopt different configurations depending on whether wave optics is modeled. We also show that systems optimized without wave optics suffer from performance degradation when wave optics effects are introduced during testing. These findings underscore the importance of accurate wave optics modeling in optimizing imaging systems for robust, high-performance applications.

可微分光学计算成像波光学联合优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。