通过几何分解与多分辨率低秩特征,实现快速高精度光场重建。
Fast Implicit Neural Light Field Representation via Geometric Decomposition and Multi-Resolution Low-Rank Features

- 将4D光场分解为水平/垂直视差与纹理平面,分块建模提升效率
- 多尺度低秩结构结合2D网格与1D线性特征,压缩参数量并加速推理
- 在公开数据集上兼顾质量、训练速度与推理效率,适合实时应用
隐式神经表示能以紧凑连续的方式从采样射线坐标重建密集光场。然而,由于光场是高维信号且存在强空间-角度冗余和结构化视差变化,快速重建仍具挑战。直接用神经网络拟合4D射线坐标通常需要大量优化时间以恢复视图外观与跨视图一致性。本文提出一种基于几何分解与多分辨率低秩特征的快速隐式光场表示方法。该方法将4D光场分解为水平视差平面、空间纹理平面与垂直视差平面,每个平面采用低秩结构表示:结合低分辨率2D网格与多个分辨率层级上的两个高分辨率1D线特征的逐元素乘积。融合后的特征由轻量级多层感知机解码以预测RGB值。在公开光场数据集上的实验表明,该方法在保持竞争性重建质量的同时,在模型参数、训练时间和推理效率之间实现了更优权衡。
原文摘要 · Abstract (English)
Implicit neural representations provide a compact and continuous way to reconstruct dense light fields from sampled ray coordinates. However, fast light field reconstruction remains challenging because a light field is a high-dimensional signal with strong spatial-angular redundancy and structured disparity variations. Directly fitting 4D ray coordinates with a neural network often requires considerable optimization time to recover both view appearance and cross-view consistency. To address this issue, this paper proposes a fast implicit light field representation based on geometric decomposition and multi-resolution low-rank features. The proposed method decomposes a 4D light field into a horizontal disparity plane, a spatial texture plane, and a vertical disparity plane. Each plane is represented by a low-rank structure that combines a low-resolution 2D grid with the element-wise product of two high-resolution 1D line features at multiple resolution levels. The fused features are decoded by a lightweight multilayer perceptron to predict RGB values. Experiments on public light field datasets show that the proposed method achieves competitive reconstruction quality while providing a better trade-off among model parameters, training time, and inference efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。