arXiv:2505.13050cs.CV2025-05NeurIPS被引 9

从普通照片还原偏振信息,开启新研究方向

RGB-to-Polarization Estimation: A New Task and Benchmark Study

  • 从RGB图像直接推断偏振特征,无需特殊相机
  • 首次建立完整基准,覆盖多种主流深度模型
  • 揭示生成与重建模型优劣,指导未来研究

偏振图像包含标准RGB图像所缺乏的丰富物理信息,对反射分离、材质分类等计算机视觉任务有重要价值。但获取偏振图像通常需额外光学元件,增加成本与复杂度。为此,我们提出新任务:从RGB图像估计偏振信息。本文通过整合现有偏振数据集,构建首个全面基准,评估多种先进深度学习模型,涵盖修复型与生成型架构。通过大量定量与定性分析,该基准不仅确立了当前估计性能上限,还系统揭示不同模型族的优劣——如直接重建与生成合成的差异,以及任务专用训练与大规模预训练的效果。此外,还指出了未来研究的潜在方向。本基准旨在成为未来基于标准RGB输入进行偏振估计方法设计与评估的基础资源。

原文摘要 · Abstract (English)

Polarization images provide rich physical information that is fundamentally absent from standard RGB images, benefiting a wide range of computer vision applications such as reflection separation and material classification. However, the acquisition of polarization images typically requires additional optical components, which increases both the cost and the complexity of the applications. To bridge this gap, we introduce a new task: RGB-to-polarization image estimation, which aims to infer polarization information directly from RGB images. In this work, we establish the first comprehensive benchmark for this task by leveraging existing polarization datasets and evaluating a diverse set of state-of-the-art deep learning models, including both restoration-oriented and generative architectures. Through extensive quantitative and qualitative analysis, our benchmark not only establishes the current performance ceiling of RGB-to-polarization estimation, but also systematically reveals the respective strengths and limitations of different model families -- such as direct reconstruction versus generative synthesis, and task-specific training versus large-scale pre-training. In addition, we provide some potential directions for future research on polarization estimation. This benchmark is intended to serve as a foundational resource to facilitate the design and evaluation of future methods for polarization estimation from standard RGB inputs.

偏振估计图像生成基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。