通过跨通道感知学习,提升从H&E切片生成IHC图像的准确性。
Cross-channel Perception Learning for H&E-to-IHC Virtual Staining
- 分解IHC为核与膜两通道,显式建模其关联性。
- 在真实与生成图像间保持染色分布和强度一致,PSNR超28.5。
- 无需增加推理负担,适合临床病理自动化系统部署。
随着数字病理学快速发展,虚拟染色已成为多媒体医疗信息系统的关键技术,为病理图像分析与诊断提供新可能。然而,现有H&E-to-IHC研究常忽略细胞核与细胞膜之间的跨通道相关性。为此,本文提出一种新型跨通道感知学习(CCPL)策略:首先将HER2免疫组化染色分解为苏木精与DAB染色通道,分别对应细胞核与细胞膜;利用病理基础模型Gigapath的Tile Encoder,从生成与真实图像中提取双通道特征,并度量核与膜间的跨通道相关性;同时,通过特征蒸馏损失增强模型特征提取能力,不增加推理开销;此外,对单通道的焦点光密度图进行统计分析,确保染色分布与强度一致性。基于PSNR、SSIM、PCC、FID等定量指标及病理科医生的专业评估,实验表明CCPL能有效保留病理特征,生成高质量虚拟染色图像,为多模态医疗数据驱动的自动化病理诊断提供有力支持。
原文摘要 · Abstract (English)
With the rapid development of digital pathology, virtual staining has become a key technology in multimedia medical information systems, offering new possibilities for the analysis and diagnosis of pathological images. However, existing H&E-to-IHC studies often overlook the cross-channel correlations between cell nuclei and cell membranes. To address this issue, we propose a novel Cross-Channel Perception Learning (CCPL) strategy. Specifically, CCPL first decomposes HER2 immunohistochemical staining into Hematoxylin and DAB staining channels, corresponding to cell nuclei and cell membranes, respectively. Using the pathology foundation model Gigapath's Tile Encoder, CCPL extracts dual-channel features from both the generated and real images and measures cross-channel correlations between nuclei and membranes. The features of the generated and real stained images, obtained through the Tile Encoder, are also used to calculate feature distillation loss, enhancing the model's feature extraction capabilities without increasing the inference burden. Additionally, CCPL performs statistical analysis on the focal optical density maps of both single channels to ensure consistency in staining distribution and intensity. Experimental results, based on quantitative metrics such as PSNR, SSIM, PCC, and FID, along with professional evaluations from pathologists, demonstrate that CCPL effectively preserves pathological features, generates high-quality virtual stained images, and provides robust support for automated pathological diagnosis using multimedia medical data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。