arXiv:2511.17126eess.IVcs.CV2025-11中稿 · 2026 IEEE Internat…

用大规模镜头库和离散退化先验,实现未知镜头像差的零样本校正与高效少样本适配。

Towards Blind Lens Aberration Correction via Large LensLib Pre-training and Discrete Degradation Priors

  • 构建大规模镜头库AODLibpro,提升训练数据多样性与可扩展性。
  • 通过向量量化学习离散退化先验,显著提升零样本恢复性能。
  • 支持高效少样本适配,适合实际部署中未知镜头的快速校正。

基于深度学习的镜头库预训练(LensLib-PT)为盲源镜头像差校正提供了新路径,通过训练通用神经网络,展现出处理多种未知光学退化的强大能力。本文提出FoundCAC,一个通用基础框架,解决现有流程泛化受限的两大挑战:训练数据难以扩展、缺乏表征光学退化的先验知识。为提升数据可扩展性,通过分层采样空间变化模式与退化严重度,构建了大规模镜头库AODLibpro。在模型设计上,为利用点扩散函数(PSFs)作为引导同时保持盲校正范式,提出多阶段向量量化表示学习方案,专门构建潜在PSF表示(LPR),将复杂的连续PSFs显式编码为离散退化先验,以正则化高度病态的恢复过程。通过简单的无代码本冻结策略,框架利用离散先验提升全量恢复性能,并解锁对未见镜头的高效少样本适配。在合成LensLib、真实设计仿真及实拍镜头上的实验表明,该框架在互补评估协议下实现最先进的零样本性能,同时支持针对特定镜头的高效少样本适应。源代码与数据集将公开于https://github.com/zju-jiangqi/FoundCAC。

原文摘要 · Abstract (English)

Emerging deep-learning-based lens library pre-training (LensLib-PT) pipeline offers a new avenue for blind lens aberration correction by training a universal neural network, demonstrating strong capability in handling diverse unknown optical degradations. This work proposes FoundCAC, a universal foundational framework that resolves two challenges hindering the generalization of existing pipelines: the difficulty of scaling training data and the absence of prior guidance characterizing optical degradation. To improve data scalability, we expand the design specifications to increase degradation diversity and construct AODLibpro, a large-scale lens library using stratified sampling over spatial-variation patterns and degradation severity. In terms of model design, to leverage Point Spread Functions (PSFs) as guidance while maintaining the blind paradigm, we propose a multi-stage vector-quantized representation learning scheme. This paradigm is specifically designed to construct a Latent PSF Representation (LPR), explicitly encoding complex continuous PSFs into a discrete degradation prior to regularize the highly ill-posed restoration process. Through a simple yet effective codebook-freezing strategy, our framework leverages the discrete prior to elevate full-shot restoration performance and unlock highly efficient few-shot adaptation for unseen lenses. Experiments on synthetic LensLib, real-design simulations, and real-captured lenses show that our framework achieves state-of-the-art zero-shot performance under complementary evaluation protocols, while enabling highly efficient few-shot adaptation for specific lenses. The source code and datasets will be made publicly available at https://github.com/zju-jiangqi/FoundCAC.

图像修复镜头校正预训练少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。