构建首个极化图像补丁超分辨基准数据集,解决噪声建模与重建难题。
Benchmarking Burst Super-Resolution for Polarization Images: Noise Dataset and Analysis
- 设计专用极化图像噪声数据集PolarNS,量化噪声传播机制。
- 提出PolarBurstSR基准,验证极化域超分辨模型优于通用方法。
- 在真实光照条件下采集数据,支持跨场景性能评估。
快照式极化成像通过双拜耳传感器同时获取颜色与偏振信息,但存在低光效率和低空间分辨率问题,导致噪声增加和偏振测量失真。尽管补丁超分辨可有效降噪并提升分辨率,但缺乏针对极化成像的专用数据集和可靠的真实噪声统计。为此,本文提出PolarNS与PolarBurstSR两个创新数据集:PolarNS用于表征极化噪声统计特性,支持深入分析;PolarBurstSR作为极化图像补丁超分辨的基准测试集。两类数据均在多种真实场景下采集,支持全面评估。此外,本文构建噪声传播分析模型,在暗室环境下大规模数据上验证。实验对比了最新补丁超分辨模型,表明专为极化设计的训练方法显著优于基于RGB的方法。本工作建立了极化图像补丁超分辨的基准,揭示了噪声传播规律,推动了极化图像重建技术发展。
原文摘要 · Abstract (English)
Snapshot polarization imaging calculates polarization states from linearly polarized subimages. To achieve this, a polarization camera employs a double Bayer-patterned sensor to capture both color and polarization. It demonstrates low light efficiency and low spatial resolution, resulting in increased noise and compromised polarization measurements. Although burst super-resolution effectively reduces noise and enhances spatial resolution, applying it to polarization imaging poses challenges due to the lack of tailored datasets and reliable ground truth noise statistics. To address these issues, we introduce PolarNS and PolarBurstSR, two innovative datasets developed specifically for polarization imaging. PolarNS provides characterization of polarization noise statistics, facilitating thorough analysis, while PolarBurstSR functions as a benchmark for burst super-resolution in polarization images. These datasets, collected under various real-world conditions, enable comprehensive evaluation. Additionally, we present a model for analyzing polarization noise to quantify noise propagation, tested on a large dataset captured in a darkroom environment. As part of our application, we compare the latest burst super-resolution models, highlighting the advantages of training tailored to polarization compared to RGB-based methods. This work establishes a benchmark for polarization burst super-resolution and offers critical insights into noise propagation, thereby enhancing polarization image reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。