arXiv:2506.18371eess.IVcs.CV2025-06

用H&E切片生成IHC图像,低成本实现乳腺癌精准分型

Transforming H&E images into IHC: A Variance-Penalized GAN for Precision Oncology

  • 改进GAN损失函数,加入方差惩罚防止生成图像失真
  • 在BCI数据集上生成图像的PSNR达22.16,显著优于基线
  • 特别擅长生成HER2阳性(IHC 3+)图像,临床价值高

HER2过度表达是侵袭性乳腺癌的关键驱动因素,需精准诊断与靶向治疗。免疫组化(IHC)虽为标准方法,但成本高、耗时长且依赖抗体选择;而常规的苏木精-伊红(H&E)染色虽普及,却无HER2特异性。本研究提出一种基于深度学习的图像翻译框架,从H&E切片生成高质量IHC图像,实现低成本、可扩展的HER2评估。通过修改金字塔pix2pix的损失函数,缓解生成对抗网络(GAN)的模式崩溃问题,并引入新型基于方差的惩罚项,增强生成图像的结构多样性。模型在生成HER2阳性(IHC 3+)图像方面表现尤为出色。在整体BCI数据集上的定量评估显示,本方法在峰值信噪比(PSNR)达22.16,结构相似性指数(SSIM)为0.47,弗雷歇起始距离(FID)为346.37,显著优于金字塔pix2pix基线(PSNR 21.15,SSIM 0.43,FID 516.75)和标准pix2pix(PSNR 20.74,SSIM 0.44,FID 472.6)。结果表明生成图像具有更高保真度与真实感。该模型在通用图像翻译任务中亦表现优异,展现出跨领域潜力。本工作推动了人工智能驱动的精准肿瘤学发展。

原文摘要 · Abstract (English)

The overexpression of the human epidermal growth factor receptor 2 (HER2) in breast cells is a key driver of HER2-positive breast cancer, a highly aggressive subtype requiring precise diagnosis and targeted therapy. Immunohistochemistry (IHC) is the standard technique for HER2 assessment but is costly, labor-intensive, and highly dependent on antibody selection. In contrast, hematoxylin and eosin (H&E) staining, a routine histopathological procedure, offers broader accessibility but lacks HER2 specificity. This study proposes an advanced deep learning-based image translation framework to generate high-fidelity IHC images from H&E-stained tissue samples, enabling cost-effective and scalable HER2 assessment. By modifying the loss function of pyramid pix2pix, we mitigate mode collapse, a fundamental limitation in generative adversarial networks (GANs), and introduce a novel variance-based penalty that enforces structural diversity in generated images. Our model particularly excels in translating HER2-positive (IHC 3+) images, which have remained challenging for existing methods. Quantitative evaluations on the overall BCI dataset reveal that our approach outperforms baseline models, achieving a peak signal-to-noise ratio (PSNR) of 22.16, a structural similarity index (SSIM) of 0.47, and a Fréchet Inception Distance (FID) of 346.37. In comparison, the pyramid pix2pix baseline attained PSNR 21.15, SSIM 0.43, and FID 516.75, while the standard pix2pix model yielded PSNR 20.74, SSIM 0.44, and FID 472.6. These results affirm the superior fidelity and realism of our generated IHC images. Beyond medical imaging, our model exhibits superior performance in general image-to-image translation tasks, showcasing its potential across multiple domains. This work marks a significant step toward AI-driven precision oncology, offering a reliable and efficient alternative to traditional HER2 diagnostics.

图像生成精准医疗病理分析GAN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。