arXiv:2608.23175cs.CV2026-08

用邻近相机信息修复缺失视角,提升光场相机容错能力

Neighbor-Aware View Synthesis for Restoring Missing Views in Light-Field Camera Arrays

论文配图:Neighbor-Aware View Synthesis for Restoring Missing Views in Light-Field Camera Arrays
图 1 · 摘自论文原文
  • 通过选择邻近相机图像与位置编码,引导生成对抗网络重建缺失视角
  • 在合成与真实数据集上均超越基线方法,视觉与光照一致性更优
  • 适合光场成像系统容错、硬件故障场景下的图像恢复应用

在光场成像系统中,密集的空间采样来自相机阵列,支持重聚焦和深度估计等后期处理功能。然而,实际采集常受硬件故障影响,阵列中一个或多个相机失效,导致子孔径图像缺失,进而降低重建质量。本文针对光场相机阵列中的缺陷或缺失视角恢复问题,提出一种新颖的生成式框架:利用精心选取的邻近相机图像,结合表示其位置及目标视点的位置编码图,输入条件生成对抗网络(cGAN),以几何一致的方式生成缺失视角。在合成与真实光场数据集上的大量实验表明,该方法生成的重建结果在视觉上合理、光照准确,定量与定性评估均优于基线方法。所提框架为光场图像采集提供了鲁棒高效的容错解决方案。

原文摘要 · Abstract (English)

In light-field (LF) imaging systems, dense spatial sampling from a camera array enables powerful post-capture capabilities such as refocusing and depth estimation. However, real-world LF capture is often affected by hardware malfunctions, where one or more cameras in the array fail, leading to missing sub-aperture images and degraded reconstruction quality. This paper addresses the problem of defective or missing view restoration in light-field camera arrays. We propose a novel generative framework that synthesizes the absent views by exploiting information from a carefully selected subset of neighboring cameras. These selected images, along with a positional encoding map indicating both their locations and the desired target view, are fed into a conditional Generative Adversarial Network (cGAN) trained to generate the missing viewpoint in a geometrically consistent manner. Extensive experiments on synthetic and real-world LF datasets demonstrate that our method produces visually plausible and photometrically accurate reconstructions, outperforming baselines for view interpolation both quantitatively and qualitatively. The proposed framework thus offers a robust and efficient solution for fault-tolerant light-field image acquisition.

光场成像视角重建生成模型容错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。