用普通摄像头辅助,让无镜头相机拍出高精度偏振图像。
Guided Lensless Polarization Imaging
- 用RGB相机提供结构信息,指导无镜头偏振成像重建。
- 两阶段流程使偏振图像质量显著优于纯无镜头方案。
- 实测原型无需微调即可在真实场景中稳定工作。
偏振成像可捕捉人眼不可见的光偏振信息,在生物医学诊断、自动驾驶和遥感等领域具有重要价值。然而,传统偏振相机通常价格昂贵且体积庞大,限制了实际应用。无镜头成像通过简单光学元件(如散射片)替代镜头,实现紧凑低成本,但现有系统重建质量有限。为此,本文提出一种基于RGB引导的无镜头偏振成像系统:结合紧凑型偏振-RGB传感器与通用的常规RGB相机,提供结构先验。采用两阶段重建流程——先通过物理模型反演获得初始偏振图像,再利用Transformer融合网络,结合常规RGB相机提供的引导图像进行精细化修复。该方法显著提升重建质量与保真度,在多个数据集和成像条件下均表现良好,并在物理原型设备上实现高质量真实成像,且无需任何微调。
原文摘要 · Abstract (English)
Polarization imaging captures the polarization state of light, revealing information invisible to the human eye yet valuable in domains such as biomedical diagnostics, autonomous driving, and remote sensing. However, conventional polarization cameras are often expensive, bulky, or both, limiting their practical use. Lensless imaging offers a compact, low-cost alternative by replacing the lens with a simple optical element like a diffuser and performing computational reconstruction, but existing lensless polarization systems suffer from limited reconstruction quality. To overcome these limitations, we introduce a RGB-guided lensless polarization imaging system that combines a compact polarization-RGB sensor with an auxiliary, widely available conventional RGB camera providing structural guidance. We reconstruct multi-angle polarization images for each RGB color channel through a two-stage pipeline: a physics-based inversion recovers an initial polarization image, followed by a Transformer-based fusion network that refines this reconstruction using the RGB guidance image from the conventional RGB camera. Our two-stage method significantly improves reconstruction quality and fidelity over lensless-only baselines, generalizes across datasets and imaging conditions, and achieves high-quality real-world results on our physical prototype lensless camera without any fine-tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。