用可变形相位板实现动态局部像差校正,提升小体积相机画质。
Fovea Stacking: Imaging with Dynamic Localized Aberration Correction

- 通过可变形相位板动态校正图像不同区域的像差。
- 多焦点叠加生成全图无像差的清晰图像,画质优于传统对焦堆叠。
- 支持实时追踪目标,适合监控或虚拟现实等场景。
小型化相机设计推动计算成像系统向光学结构简化发展,但此类系统常因光路简化导致显著像差,尤其在离轴区域,纯软件校正难度大。本文提出一种新型成像系统——视网膜堆叠(Fovea Stacking),利用新兴的可变形相位板(DPP)对图像传感器上任意位置进行局部像差校正。通过可微光学模型优化DPP形变,实现离轴区域的局部校正,生成以注视点为中心的锐化图像,类似人眼视网膜中央凹。将多个注视点不同的锐化图像堆叠,可获得全域无像差的合成图像。为高效覆盖视场,提出在成像预算约束下联合优化DPP形变。针对DPP非线性特性,引入神经网络控制模型以提升仿真与硬件性能一致性。实验表明,在扩展景深成像中,视网膜堆叠的图像质量优于传统对焦堆叠。结合目标检测或眼动追踪,系统可动态调整镜头,实现实时视锥视频,适用于监控、视锥显示等下游应用。
原文摘要 · Abstract (English)
The desire for cameras with smaller form factors has recently lead to a push for exploring computational imaging systems with reduced optical complexity such as a smaller number of lens elements. Unfortunately such simplified optical systems usually suffer from severe aberrations, especially in off-axis regions, which can be difficult to correct purely in software. In this paper we introduce Fovea Stacking , a new type of imaging system that utilizes emerging dynamic optical components called deformable phase plates (DPPs) for localized aberration correction anywhere on the image sensor. By optimizing DPP deformations through a differentiable optical model, off-axis aberrations are corrected locally, producing a foveated image with enhanced sharpness at the fixation point - analogous to the eye's fovea. Stacking multiple such foveated images, each with a different fixation point, yields a composite image free from aberrations. To efficiently cover the entire field of view, we propose joint optimization of DPP deformations under imaging budget constraints. Due to the DPP device's non-linear behavior, we introduce a neural network-based control model for improved alignment between simulation-hardware performance. We further demonstrated that for extended depth-of-field imaging, fovea stacking outperforms traditional focus stacking in image quality. By integrating object detection or eye-tracking, the system can dynamically adjust the lens to track the object of interest-enabling real-time foveated video suitable for downstream applications such as surveillance or foveated virtual reality displays
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。