arXiv:2506.00716cs.CV2025-06被引 1

用可变形相位板实现动态局部像差校正,提升小体积相机画质。

Fovea Stacking: Imaging with Dynamic Localized Aberration Correction

论文配图:Fovea Stacking: Imaging with Dynamic Localized Aberration Correction
图 1 · 摘自论文原文
  • 通过可变形相位板动态校正图像不同区域的像差。
  • 多焦点叠加生成全图无像差的清晰图像,画质优于传统对焦堆叠。
  • 支持实时追踪目标,适合监控或虚拟现实等场景。

小型化相机设计推动计算成像系统向光学结构简化发展,但此类系统常因光路简化导致显著像差,尤其在离轴区域,纯软件校正难度大。本文提出一种新型成像系统——视网膜堆叠(Fovea Stacking),利用新兴的可变形相位板(DPP)对图像传感器上任意位置进行局部像差校正。通过可微光学模型优化DPP形变,实现离轴区域的局部校正,生成以注视点为中心的锐化图像,类似人眼视网膜中央凹。将多个注视点不同的锐化图像堆叠,可获得全域无像差的合成图像。为高效覆盖视场,提出在成像预算约束下联合优化DPP形变。针对DPP非线性特性,引入神经网络控制模型以提升仿真与硬件性能一致性。实验表明,在扩展景深成像中,视网膜堆叠的图像质量优于传统对焦堆叠。结合目标检测或眼动追踪,系统可动态调整镜头,实现实时视锥视频,适用于监控、视锥显示等下游应用。

原文摘要 · Abstract (English)

The desire for cameras with smaller form factors has recently lead to a push for exploring computational imaging systems with reduced optical complexity such as a smaller number of lens elements. Unfortunately such simplified optical systems usually suffer from severe aberrations, especially in off-axis regions, which can be difficult to correct purely in software. In this paper we introduce Fovea Stacking , a new type of imaging system that utilizes emerging dynamic optical components called deformable phase plates (DPPs) for localized aberration correction anywhere on the image sensor. By optimizing DPP deformations through a differentiable optical model, off-axis aberrations are corrected locally, producing a foveated image with enhanced sharpness at the fixation point - analogous to the eye's fovea. Stacking multiple such foveated images, each with a different fixation point, yields a composite image free from aberrations. To efficiently cover the entire field of view, we propose joint optimization of DPP deformations under imaging budget constraints. Due to the DPP device's non-linear behavior, we introduce a neural network-based control model for improved alignment between simulation-hardware performance. We further demonstrated that for extended depth-of-field imaging, fovea stacking outperforms traditional focus stacking in image quality. By integrating object detection or eye-tracking, the system can dynamically adjust the lens to track the object of interest-enabling real-time foveated video suitable for downstream applications such as surveillance or foveated virtual reality displays

计算成像动态光学视锥成像可变形相位板

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。