用偏振成像补足传统染色的不足,提升病理诊断精度。
Beyond H&E: Unlocking Pathological Insights with Polarization Imaging
- 构建偏振与H&E配对图像数据集,融合双模态信息增强组织表征。
- 在两个数据集上分别达到86.70%和89.06%准确率,显著优于旧方法。
- 适合关注多模态学习、病理图像分析与临床可解释性的研究者。
组织病理学图像分析是数字病理的核心,而苏木精-伊红(H&E)染色是诊断与预后评估的金标准。尽管H&E能有效显示细胞与组织结构,却缺乏对双折射性和各向异性的敏感性,而这正是评估胶原排列、纤维取向及微结构改变的关键指标,这些特征与肿瘤进展、纤维化等病理状态密切相关。为弥补这一不足,我们搭建了偏振成像系统,并构建了一个包含超过13,000对偏振-H&E图像的新数据集。偏振特性可视化揭示了病理性组织的独特光学特征,凸显其诊断价值。基于此数据集,我们提出PolarHE双模态融合框架,利用偏振成像能力提升组织表征。该方法采用特征分解策略,分离共通与模态特异性特征,实现有效的多模态表示学习。全面验证表明,该方法显著优于以往方法,在Chaoyang数据集上达到86.70%准确率,在MHIST数据集上达89.06%。结果表明,偏振成像是计算病理中强大且未被充分使用的模态,可丰富特征表达并提升诊断准确性。PolarHE为多模态学习开辟新路径,推动更具可解释性与泛化能力的病理模型发展。
原文摘要 · Abstract (English)
Histopathology image analysis is fundamental to digital pathology, with hematoxylin and eosin (H&E) staining as the gold standard for diagnostic and prognostic assessments. While H&E imaging effectively highlights cellular and tissue structures, it lacks sensitivity to birefringence and tissue anisotropy, which are crucial for assessing collagen organization, fiber alignment, and microstructural alterations--key indicators of tumor progression, fibrosis, and other pathological conditions. To bridge this gap, we construct a polarization imaging system and curate a new dataset of over 13,000 paired Polar-H&E images. Visualizations of polarization properties reveal distinctive optical signatures in pathological tissues, underscoring its diagnostic value. Building on this dataset, we propose PolarHE, a dual-modality fusion framework that integrates H&E with polarization imaging, leveraging the latter ability to enhance tissue characterization. Our approach employs a feature decomposition strategy to disentangle common and modality specific features, ensuring effective multimodal representation learning. Through comprehensive validation, our approach significantly outperforms previous methods, achieving an accuracy of 86.70% on the Chaoyang dataset and 89.06% on the MHIST dataset. These results demonstrate that polarization imaging is a powerful and underutilized modality in computational pathology, enriching feature representation and improving diagnostic accuracy. PolarHE establishes a promising direction for multimodal learning, paving the way for more interpretable and generalizable pathology models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。