用对抗学习提升虚拟染色病理保真度,解决真实染色难题。
Leveraging Adversarial Learning for Pathological Fidelity in Virtual Staining
- 基于条件GAN设计新模型CSSP2P,增强病理特征保留。
- 盲评专家验证显示病理保真度显著提升。
- 揭示对抗损失对图像质量的关键作用,适合病理医生与算法研究者。
除了使用H&E染色评估肿瘤形态外,免疫组化还可用于检测组织中特定蛋白的存在。然而该方法成本高、耗时长。虚拟染色作为图像到图像的转换任务,提供了有前景的替代方案。尽管近年才兴起,2024年已有64%的相关研究发表。多数研究依赖连续切片的H&E-IHC配对公开数据集。面对训练挑战,许多作者构建复杂的条件生成对抗网络模型,却忽视对抗损失对虚拟染色质量的影响。此外,评估时忽略模型评价问题,仅依赖SSIM和PSNR等不够稳健的指标声称性能提升。本文提出CSSP2P GAN,通过盲病理专家评估证明其在病理保真度上的显著提升。同时,在迭代开发过程中,研究了对抗损失的影响,证实其对图像质量至关重要。最后,与领域内参考工作对比,指出现有评价指标的局限性,并展示CSSP2P GAN的优越性能。
原文摘要 · Abstract (English)
In addition to evaluating tumor morphology using H&E staining, immunohistochemistry is used to assess the presence of specific proteins within the tissue. However, this is a costly and labor-intensive technique, for which virtual staining, as an image-to-image translation task, offers a promising alternative. Although recent, this is an emerging field of research with 64% of published studies just in 2024. Most studies use publicly available datasets of H&E-IHC pairs from consecutive tissue sections. Recognizing the training challenges, many authors develop complex virtual staining models based on conditional Generative Adversarial Networks, but ignore the impact of adversarial loss on the quality of virtual staining. Furthermore, overlooking the issues of model evaluation, they claim improved performance based on metrics such as SSIM and PSNR, which are not sufficiently robust to evaluate the quality of virtually stained images. In this paper, we developed CSSP2P GAN, which we demonstrate to achieve heightened pathological fidelity through a blind pathological expert evaluation. Furthermore, while iteratively developing our model, we study the impact of the adversarial loss and demonstrate its crucial role in the quality of virtually stained images. Finally, while comparing our model with reference works in the field, we underscore the limitations of the currently used evaluation metrics and demonstrate the superior performance of CSSP2P GAN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。