arXiv:2409.05809physics.opticscs.CV2024-09中稿 · Optics & Laser Tec…被引 2

用自动生成的镜头库实现任意镜头像差的通用矫正,无需镜头描述。

OmniLens: Towards Universal Lens Aberration Correction via LensLib-to-Specific Domain Adaptation

  • 基于进化设计生成覆盖广泛的镜头库,预训练强泛化能力模型。
  • 仅需少量实拍图像,即可在无描述情况下快速适配特定镜头,提升严重像差矫正效果。
  • 适合需要低成本部署、面对未知镜头的成像系统开发者使用。

新兴的通用计算像差矫正(CAC)范式通过在镜头库(LensLib)上训练通用模型,实现了轻量级高质量成像。然而,现有镜头库覆盖有限,导致模型对未见镜头泛化能力差,且微调依赖已知镜头描述。本文提出OmniLens,通过(i)构建涵盖广泛镜头设计的可信镜头库以预训练鲁棒基模型,(ii)利用快速的镜头库到特定镜头的域自适应,将模型适配至任意未知描述的镜头。为此,我们提出基于进化的自动光学设计(EAOD)流水线,生成具有真实像差特性的多样化镜头样本。同时,设计一种无监督正则项,基于镜头像差引起的暗通道先验统计特性,在少量易获取的真实图像上实现高效域适应。大量实验表明,由EAOD生成的镜头库能有效训练出具备强泛化能力的通用CAC模型,相比非盲特定镜头方法提升0.35~1.81dB PSNR;所提域自适应方法显著改善基模型,尤其在严重像差下提升达2.59dB PSNR。代码与数据将开源。

原文摘要 · Abstract (English)

Emerging universal Computational Aberration Correction (CAC) paradigms provide an inspiring solution to light-weight and high-quality imaging with a universal model trained on a lens library (LensLib) to address arbitrary lens optical aberrations blindly. However, the limited coverage of existing LensLibs leads to poor generalization of the trained models to unseen lenses, whose fine-tuning pipeline is also confined to the lens-descriptions-known case. In this work, we introduce OmniLens, a flexible solution to universal CAC via (i) establishing a convincing LensLib with comprehensive coverage for pre-training a robust base model, and (ii) adapting the model to any specific lens designs with unknown lens descriptions via fast LensLib-to-specific domain adaptation. To achieve these, an Evolution-based Automatic Optical Design (EAOD) pipeline is proposed to generate a rich variety of lens samples with realistic aberration behaviors. Then, we design an unsupervised regularization term for efficient domain adaptation on a few easily accessible real-captured images based on the statistical observation of dark channel priors in degradation induced by lens aberrations. Extensive experiments demonstrate that the LensLib generated by EAOD effectively develops a universal CAC model with strong generalization capabilities, which can also improve the non-blind lens-specific methods by 0.35~1.81dB in PSNR. Additionally, the proposed domain adaptation method significantly improves the base model, especially in severe aberration cases (at most 2.59dB in PSNR). The code and data will be available at https://github.com/zju-jiangqi/OmniLens.

像差矫正镜头建模域自适应自动化设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。