通过预测偏振分解图实现密集学习,提升生物组织成像的标签效率。
MuellerPT: Decomposition Driven Pretraining for Dense Learning in Mueller Polarimetry

- 用物理引导的预训练方法,从每像素4×4矩阵预测卢-奇普曼分解图。
- 在5%标注数据下,分割任务Dice提升超20%,1%数据下分类准确率高8%。
- 适合少样本、跨样本场景下的生物医学偏振成像研究者使用。
穆勒矩阵成像为生物组织分析提供丰富的物理意义对比,但监督学习受限于稀疏的密集标注及样本与采集设置间的强域偏移。本文提出MuellerPT,一种基于物理引导的预训练方法,通过从每像素4×4穆勒矩阵预测卢-奇普曼分解图来学习可迁移的密集表示。为扩大预训练规模,构建了新的多光谱动物偏振器官数据集MAP-Org。预训练编码器搭配分割头用于绵羊脑灰白质分割,搭配分类头用于结直肠癌与非癌分类。两者均在少样本学习场景下评估。分割任务中,相比无预训练模型,MuellerPT显著提升标签效率和跨样本迁移能力,在仅用5%训练数据时,绝对Dice增益超过20%;分类任务中,使用1%数据时,整体准确率相较基线提升8%。通过在离体人食管样本上的定性评估,验证了其对域偏移的鲁棒性。结果表明,预测卢-奇普曼分解是一种有效且实用的预训练任务,可推动标签高效的穆勒成像未来发展。
原文摘要 · Abstract (English)
Mueller matrix imaging provides rich, physically meaningful contrast for biomedical tissue analysis, but supervised learning is hindered by scarce dense annotations and strong domain shifts across specimens and acquisition settings. We introduce MuellerPT, a physics guided pre-training approach that learns transferable dense representations by predicting Lu-Chipman decomposition maps from per-pixel 4x4 Mueller matrices. To scale pre-training, we collected a new large Multispectral Animal Polarimetric Organ dataset (MAP-Org). The pre-trained encoder is adapted with a segmentation head for grey vs. white matter segmentation in lamb brain. A classification head is used for colorectal cancer vs. non-cancer classification. Both segmentation and classification are evaluated across few-shot learning scenarios. In segmentation, MuellerPT improves label efficiency and cross specimen transfer compared to models without pre-training, achieving an absolute DICE gain of over 20% compared to the baseline trained from scratch when using 5% of the training data. In classification, MuellerPT also enhances label efficiency, improving overall accuracy by 8% compared to the baseline when using 1% of the training data. We demonstrate MuellerPT's robustness to domain shift with a qualitative evaluation of its predicted Lu-Chipman maps on an ex vivo human oesophagus sample. These results suggest that predicting Lu-Chipman decomposition is an effective and practical pretext task for robust biomedical inference from Mueller polarimetry and can pave the way for future work on label efficient Mueller imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。