用四元数张量建模颜色与偏振相关性,提升快照式偏振图像重建质量。
Quaternion Tensor Modeling for Joint Color-Polarization Demosaicking

- 将四个偏振角度图像编码为四元数张量,融合颜色与偏振通道相关性。
- 在斯托克斯域使用自适应正则化,显著减少重建伪影。
- 适合偏振成像、计算摄影领域研究人员参考。
平面分光(DoFP)彩色偏振相机可实现彩色偏振马赛克图像的快照采集,但其固有的稀疏采样模式使彩色偏振去马赛克问题严重不适定。现有方法常无法联合利用偏振通道间相关性及偏振成像的物理约束,导致明显重建伪影。为此,提出一种基于四元数张量的彩色偏振去马赛克(CPDM)方法,结合斯托克斯域总变差(TV)正则化。相关性分析表明,偏振通道间相关性强于颜色通道间。将0°、45°、90°、135°偏振角下的图像编码为三阶四元数张量的四个分量,颜色通道沿第三模式组织。对四元数张量施加低秩先验,以挖掘数据全局结构冗余。通过正交变换将空间梯度映射至斯托克斯域,分离强度、偏振和残差变化,自适应四元数权重实现分量特异性正则化,保持重构斯托克斯向量的能量一致性。推导出高效优化算法。大量实验表明,所提方法在去马赛克性能上优于现有方法。
原文摘要 · Abstract (English)
Division-of-focal-plane (DoFP) color polarization cameras enable snapshot acquisition of color polarization mosaic images, but the inherently sparse sampling pattern makes color polarization demosaicking severely ill-posed. Existing methods often fail to jointly exploit the correlations among polarization channels and the physical constraints inherent in polarization imaging, resulting in noticeable demosaicking artifacts. To address this issue, a quaternion-tensor-based color polarization demosaicking (CPDM) method incorporating Stokes-domain total variation (TV) regularization is proposed. Correlation analysis shows that the correlations among polarization channels are stronger than those among color channels. Accordingly, the color polarization images acquired at $0^\circ$, $45^\circ$, $90^\circ$, and $135^\circ$ are encoded into the four components of a third-order quaternion tensor, with the color channels organized along its third mode. A low-rank prior is then imposed on the quaternion tensor to exploit the global structural redundancy in the color polarization data. Moreover, spatial gradients are mapped to the Stokes domain through an orthogonal transformation to separate intensity, polarization and residual variations, with adaptive quaternion weights enabling component-specific regularization and preserving the energy consistency of the reconstructed Stokes vectors. An efficient optimization algorithm is derived for the resulting model. Extensive experiments demonstrate the superior demosaicking performance of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。