arXiv:2603.04999cs.CV2026-03

用物理约束的深度学习,从一张模糊照片恢复镜头畸变参数。

Physics-consistent deep learning for blind aberration recovery in mobile optics

  • 通过直接回归泽尼克系数+物理约束+空间图预测,实现多任务联合优化。
  • 相比仅回归系数的方法,整体性能提升35%,误差显著降低。
  • 适合需要高精度光学重建的移动摄影、显微成像等场景。

移动端摄影常受限于复杂且镜头特有的光学畸变。现有深度学习方法将此视为端到端去模糊任务,但这类“黑箱”模型缺乏显式光学建模,易产生幻觉细节;而传统盲反卷积方法则极不稳定。为此,我们提出Lens2Zernike,一种从单张模糊图像中盲恢复物理光学参数的深度学习框架。据我们所知,这是首个同时在三个不同光学领域进行监督的工作。提出新颖的物理一致性策略:直接回归泽尼克系数(z),引入可微分的物理约束(涵盖波前与点扩散函数推导,记为p),以及辅助的多任务空间图预测(m)。基于ResNet-18主干网络的消融实验表明,全量多任务框架(z+p+m)相比仅系数回归基线提升35%。对比分析显示,该方法优于两项已有深度学习方法,显著降低回归误差。最终,恢复的物理参数可用于稳定非盲反卷积,在专利的IDMxS移动端镜头数据库上有效还原严重畸变图像中的衍射极限细节。

原文摘要 · Abstract (English)

Mobile photography is often limited by complex, lens-specific optical aberrations. While recent deep learning methods approach this as an end-to-end deblurring task, these "black-box" models lack explicit optical modeling and can hallucinate details. Conversely, classical blind deconvolution remains highly unstable. To bridge this gap, we present Lens2Zernike, a deep learning framework that blindly recovers physical optical parameters from a single blurred image. To the best of our knowledge, no prior work has simultaneously integrated supervision across three distinct optical domains. We introduce a novel physics-consistent strategy that explicitly minimizes errors via direct Zernike coefficient regression (z), differentiable physics constraints encompassing both wavefront and point spread function derivations (p), and auxiliary multi-task spatial map predictions (m). Through an ablation study on a ResNet-18 backbone, we demonstrate that our full multi-task framework (z+p+m) yields a 35% improvement over coefficient-only baselines. Crucially, comparative analysis reveals that our approach outperforms two established deep learning methods from previous literature, achieving significantly lower regression errors. Ultimately, we demonstrate that these recovered physical parameters enable stable non-blind deconvolution, providing substantial in-domain improvement on the patented Institute for Digital Molecular Analytics and Science (IDMxS) Mobile Camera Lens Database for restoring diffraction-limited details from severely aberrated mobile captures.

光学重建深度学习移动摄影物理模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。