arXiv:2503.05933eess.IVcs.CV2025-03中稿 · as a regular paper…

用偏振成像补足传统染色的不足,提升病理诊断精度。

Beyond H&E: Unlocking Pathological Insights with Polarization Imaging

  • 构建偏振与H&E配对图像数据集,融合双模态信息增强组织表征。
  • 在两个数据集上分别达到86.70%和89.06%准确率,显著优于旧方法。
  • 适合关注多模态学习、病理图像分析与临床可解释性的研究者。

组织病理学图像分析是数字病理的核心,而苏木精-伊红(H&E)染色是诊断与预后评估的金标准。尽管H&E能有效显示细胞与组织结构,却缺乏对双折射性和各向异性的敏感性,而这正是评估胶原排列、纤维取向及微结构改变的关键指标,这些特征与肿瘤进展、纤维化等病理状态密切相关。为弥补这一不足,我们搭建了偏振成像系统,并构建了一个包含超过13,000对偏振-H&E图像的新数据集。偏振特性可视化揭示了病理性组织的独特光学特征,凸显其诊断价值。基于此数据集,我们提出PolarHE双模态融合框架,利用偏振成像能力提升组织表征。该方法采用特征分解策略,分离共通与模态特异性特征,实现有效的多模态表示学习。全面验证表明,该方法显著优于以往方法,在Chaoyang数据集上达到86.70%准确率,在MHIST数据集上达89.06%。结果表明,偏振成像是计算病理中强大且未被充分使用的模态,可丰富特征表达并提升诊断准确性。PolarHE为多模态学习开辟新路径,推动更具可解释性与泛化能力的病理模型发展。

原文摘要 · Abstract (English)

Histopathology image analysis is fundamental to digital pathology, with hematoxylin and eosin (H&E) staining as the gold standard for diagnostic and prognostic assessments. While H&E imaging effectively highlights cellular and tissue structures, it lacks sensitivity to birefringence and tissue anisotropy, which are crucial for assessing collagen organization, fiber alignment, and microstructural alterations--key indicators of tumor progression, fibrosis, and other pathological conditions. To bridge this gap, we construct a polarization imaging system and curate a new dataset of over 13,000 paired Polar-H&E images. Visualizations of polarization properties reveal distinctive optical signatures in pathological tissues, underscoring its diagnostic value. Building on this dataset, we propose PolarHE, a dual-modality fusion framework that integrates H&E with polarization imaging, leveraging the latter ability to enhance tissue characterization. Our approach employs a feature decomposition strategy to disentangle common and modality specific features, ensuring effective multimodal representation learning. Through comprehensive validation, our approach significantly outperforms previous methods, achieving an accuracy of 86.70% on the Chaoyang dataset and 89.06% on the MHIST dataset. These results demonstrate that polarization imaging is a powerful and underutilized modality in computational pathology, enriching feature representation and improving diagnostic accuracy. PolarHE establishes a promising direction for multimodal learning, paving the way for more interpretable and generalizable pathology models.

病理图像偏振成像多模态学习医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。