对比GAN与扩散模型在虚拟染色中的表现,发现GAN更优且提出新数据集。
GANs vs. Diffusion Models for virtual staining with the HER2match dataset
- 用新型布朗桥扩散模型实现H&E到HER2染色转换。
- 在自建数据集上GAN性能优于扩散模型,仅布朗桥模型接近。
- 公开首个同源组织切片的双染色数据集,助力后续研究。
虚拟染色利用深度生成模型重现组织化学染色,可替代传统染色流程,提升效率与成本效益。针对H&E-HER2染色迁移任务,尽管近年研究增多,但缺乏足够公开数据集,且模型框架优劣尚不明确。本文首次发布HER2match数据集,包含同一乳腺癌组织切片的H&E与HER2双染色图像,为首个此类公开数据集。我们比较多种生成对抗网络(GANs)与扩散模型(DMs),并提出一种新的布朗桥扩散模型(BBDM)。结果表明,总体上GAN表现优于扩散模型,仅BBDM达到相近水平。此外,使用HER2match训练的模型在视觉质量上显著优于基于连续切片的BCI数据集。本研究提供高质量数据集(待论文接受后开放),推动模型训练与评估,并为相关领域研究者提供方法选择参考。
原文摘要 · Abstract (English)
Virtual staining is a promising technique that uses deep generative models to recreate histological stains, providing a faster and more cost-effective alternative to traditional tissue chemical staining. Specifically for H&E-HER2 staining transfer, despite a rising trend in publications, the lack of sufficient public datasets has hindered progress in the topic. Additionally, it is currently unclear which model frameworks perform best for this particular task. In this paper, we introduce the HER2match dataset, the first publicly available dataset with the same breast cancer tissue sections stained with both H&E and HER2. Furthermore, we compare the performance of several Generative Adversarial Networks (GANs) and Diffusion Models (DMs), and implement a novel Brownian Bridge Diffusion Model for H&E-HER2 translation. Our findings indicate that, overall, GANs perform better than DMs, with only the BBDM achieving comparable results. Furthermore, we emphasize the importance of data alignment, as all models trained on HER2match produced vastly improved visuals compared to the widely used consecutive-slide BCI dataset. This research provides a new high-quality dataset ([available upon publication acceptance]), improving both model training and evaluation. In addition, our comparison of frameworks offers valuable guidance for researchers working on the topic.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。