为偏振成像设计物理一致的数据增强,提升深度学习模型泛化能力
Physically Consistent Image Augmentation for Deep Learning in Mueller Matrix Polarimetry
- 基于物理规律设计旋转翻转算法,保持穆勒矩阵偏振特性
- 在多个数据集上验证,传统增强会误导结果,新方法显著提升性能
- 特别适合小样本偏振数据集,助力科研应用落地
穆勒矩阵偏振成像能捕捉样品与偏振光相互作用的关键信息,但其独特结构给深度学习的数据增强带来挑战。标准的旋转、翻转等变换无法保留偏振特性。为此,我们提出一种通用仿真框架,可对穆勒矩阵进行物理一致的旋转与翻转,确保偏振保真度。实验结果表明,在多个数据集上,常规增强会导致错误结果,凸显基于物理的方法必要性。我们首先将该方法与真实采集数据对比,验证其物理一致性;随后在语义分割任务中应用,显著提升模型泛化能力与性能。本研究强调了偏振成像中物理感知数据增强的重要性,推动深度学习在该领域的更广泛应用,尤其适用于样本量有限的极化数据集。代码已开源:github.com/hahnec/polar_augment。
原文摘要 · Abstract (English)
Mueller matrix polarimetry captures essential information about polarized light interactions with a sample, presenting unique challenges for data augmentation in deep learning due to its distinct structure. While augmentations are an effective and affordable way to enhance dataset diversity and reduce overfitting, standard transformations like rotations and flips do not preserve the polarization properties in Mueller matrix images. To this end, we introduce a versatile simulation framework that applies physically consistent rotations and flips to Mueller matrices, tailored to maintain polarization fidelity. Our experimental results across multiple datasets reveal that conventional augmentations can lead to falsified results when applied to polarimetric data, underscoring the necessity of our physics-based approach. In our experiments, we first compare our polarization-specific augmentations against real-world captures to validate their physical consistency. We then apply these augmentations in a semantic segmentation task, achieving substantial improvements in model generalization and performance. This study underscores the necessity of physics-informed data augmentation for polarimetric imaging in deep learning (DL), paving the way for broader adoption and more robust applications across diverse research in the field. In particular, our framework unlocks the potential of DL models for polarimetric datasets with limited sample sizes. Our code implementation is available at github.com/hahnec/polar_augment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。