arXiv:2504.00490cs.CV2025-04被引 1

用新模型将廉价染色图像转为特异性抗体染色图,提升病理分析效率。

SCFANet: Style Distribution Constraint Feature Alignment Network For Pathological Staining Translation

  • 引入风格分布约束与特征对齐模块,解决染色风格差异问题。
  • 在乳腺癌数据集上实现更精准的图像转换,保持病理模式一致。
  • 适合需要高效生成IHC图像的病理研究者使用。

免疫组化(IHC)染色通过抗体标记特定抗原或蛋白质,是病理诊断的重要手段,但过程耗时且成本高。为应对这一挑战,利用深度学习直接将低成本的苏木精-伊红(H&E)染色图像转换为IHC图像成为高效解决方案。然而,从H&E到IHC的转换面临图像对齐偏差及IHC染色风格多样性的双重挑战。为此,本文提出风格分布约束特征对齐网络(SCFANet),包含两个创新模块:风格分布约束器(SDC)和特征对齐学习(FAL)。SDC通过周期一致性损失保持结构一致性,并确保生成图像与目标图像在风格分布上一致;FAL将端到端转换任务分解为图像重建与特征对齐两个子任务,降低复杂度。同时,通过维持病理模式一致性和光学密度(OD)均匀性,保障生成图像的病理可靠性。在乳腺癌免疫组化(BCI)数据集上的大量实验表明,SCFANet优于现有方法,能精确实现H&E到IHC图像的转换。该方法不仅克服了技术难题,还为病理分析中的染色转换提供了稳健框架。

原文摘要 · Abstract (English)

Immunohistochemical (IHC) staining serves as a valuable technique for detecting specific antigens or proteins through antibody-mediated visualization. However, the IHC staining process is both time-consuming and costly. To address these limitations, the application of deep learning models for direct translation of cost-effective Hematoxylin and Eosin (H&E) stained images into IHC stained images has emerged as an efficient solution. Nevertheless, the conversion from H&E to IHC images presents significant challenges, primarily due to alignment discrepancies between image pairs and the inherent diversity in IHC staining style patterns. To overcome these challenges, we propose the Style Distribution Constraint Feature Alignment Network (SCFANet), which incorporates two innovative modules: the Style Distribution Constrainer (SDC) and Feature Alignment Learning (FAL). The SDC ensures consistency between the generated and target images' style distributions while integrating cycle consistency loss to maintain structural consistency. To mitigate the complexity of direct image-to-image translation, the FAL module decomposes the end-to-end translation task into two subtasks: image reconstruction and feature alignment. Furthermore, we ensure pathological consistency between generated and target images by maintaining pathological pattern consistency and Optical Density (OD) uniformity. Extensive experiments conducted on the Breast Cancer Immunohistochemical (BCI) dataset demonstrate that our SCFANet model outperforms existing methods, achieving precise transformation of H&E-stained images into their IHC-stained counterparts. The proposed approach not only addresses the technical challenges in H&E to IHC image translation but also provides a robust framework for accurate and efficient stain conversion in pathological analysis.

图像转换病理分析深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。