提出GTF模型,用四方向EPI提升光场超分辨率效果。
GTF: Omnidirectional EPI Transformer for Light Field Super-Resolution

- 构建统一框架,同时处理四个方向的视点图像
- 在真实与合成数据集上达32.78 dB峰值性能
- 轻量版仅0.915M参数,适合高效部署
光场图像超分辨率利用视点图像(EPI)中线斜率显式编码深度信息。现有基于Transformer的方法主要关注水平和垂直EPI,忽略了对角方向的几何结构。本文提出GTF,一种全向EPI Transformer,统一建模水平、垂直、45度和135度方向的EPI。GTF结合方向性EPI处理、MacPI先验注入、自适应方向融合及拓扑保持前馈网络,更充分挖掘光场几何特性。在NTIRE 2026保真度赛道中,以GTF为主模型;轻量版GTF-Tiny用于效率赛道。在五个标准光场超分基准上,无推理增强时达到32.78 dB;结合EPSW与测试时增强后性能更优。在效率约束下,GTF-Tiny仅需0.915M参数和19.81 GFLOPs,仍达32.57 dB。在NTIRE 2026光场图像超分辨率挑战赛中,提交结果在第一、三赛道排名第三,第二赛道第四。架构演化、通道宽度与推理分析进一步验证对角EPI建模、方向融合及轻量化设计的有效性。
原文摘要 · Abstract (English)
Light field (LF) image super-resolution benefits from Epipolar Plane Images (EPIs), whose line slopes explicitly encode disparity. However, existing Transformer-based LF SR methods mainly attend to horizontal and vertical EPIs, leaving diagonal epipolar geometry underexplored. We present GTF, an omnidirectional EPI Transformer that explicitly models horizontal, vertical, 45-degree, and 135-degree EPIs within a unified reconstruction framework. GTF combines directional EPI processing, MacPI-based prior injection, adaptive directional fusion, and a topology-preserving feed-forward network to better exploit LF geometry. For the NTIRE 2026 fidelity tracks, we use GTF as the main model, while a lightweight GTF-Tiny variant targets the efficiency track. On five standard LF SR benchmarks covering both real-captured and synthetic scenes, GTF reaches 32.78 dB without inference-time enhancement, and stronger inference settings with EPSW and test-time augmentation further improve performance. Under the NTIRE 2026 efficiency constraint, GTF-Tiny attains 32.57 dB with only 0.915M parameters and 19.81 GFLOPs. In the NTIRE 2026 Light Field Image Super-Resolution Challenge, our submissions rank 3rd on Track 1 and Track 3 and 4th on Track 2. Architecture-evolution, channel-width, and inference analyses further support the effectiveness of diagonal EPI modeling, directional fusion, and the lightweight design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。