arXiv:2603.23071cs.CV2026-03

首个联合优化去马赛克与下游任务的偏振成像框架,提升表面估计等应用效果。

PolarAPP: Beyond Polarization Demosaicking for Polarimetric Applications

  • 通过元学习实现去马赛克与下游网络特征对齐,使重建过程任务感知
  • 引入等效成像约束,直接回归物理有意义输出,无需数据重排
  • 分阶段优化:先稳定去马赛克,再精调任务网络,适合偏振视觉应用

偏振成像通过捕捉表面-材料相互作用,支持法向估计、去反射等高级视觉应用。然而现有方法依赖于将分焦面传感器原始数据简单重组生成的数据集,仅提取同偏振角像素并拼接为稀疏图像,缺乏合理去马赛克,导致目标不完整、性能受限。当前去马赛克方法均为任务无关,仅优化光度保真度。为此,本文提出PolarAPP,首个联合优化去马赛克与下游任务的框架。PolarAPP引入特征对齐机制,通过元学习语义对齐去马赛克与下游网络表示,引导重建过程任务感知;进一步采用等效成像约束,实现无需数据重排的物理意义输出直接回归;最后通过任务精炼阶段,利用稳定去马赛克前端微调任务网络以提升精度。大量实验表明,PolarAPP在去马赛克质量与下游性能上均优于现有方法。代码将在接受后公开。

原文摘要 · Abstract (English)

Polarimetric imaging enables advanced vision applications such as normal estimation and de-reflection by capturing unique surface-material interactions. However, existing applications (alternatively called downstream tasks) rely on datasets constructed by naively regrouping raw measurements from division-of-focal-plane sensors, where pixels of the same polarization angle are extracted and aligned into sparse images without proper demosaicking. This reconstruction strategy results in suboptimal, incomplete targets that limit downstream performance. Moreover, current demosaicking methods are task-agnostic, optimizing only for photometric fidelity rather than utility in downstream tasks. Towards this end, we propose PolarAPP, the first framework to jointly optimize demosaicking and its downstream tasks. PolarAPP introduces a feature alignment mechanism that semantically aligns the representations of demosaicking and downstream networks via meta-learning, guiding the reconstruction to be task-aware. It further employs an equivalent imaging constraint for demosaicking training, enabling direct regression to physically meaningful outputs without relying on rearranged data. Finally, a task-refinement stage fine-tunes the task network using the stable demosaicking front-end to further enhance accuracy. Extensive experimental results demonstrate that PolarAPP outperforms existing methods in both demosaicking quality and downstream performance. Code is available upon acceptance.

偏振成像去马赛克任务感知元学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。