用1万张癌组织切片训练出可生成逼真病理图像的扩散模型。
CytoSyn: a Foundation Diffusion Model for Histopathology -- Tech Report
- 基于潜空间扩散模型,实现可控生成高真实感病理H&E染色图像
- 在32种癌症数据上训练,仍能生成炎症性肠病图像,泛化能力强
- 开源模型与数据,支持虚拟染色等病理研究新应用
近年来,计算病理学取得显著进展,推动了疾病机理理解与临床工具的发展。这一进步得益于大量数字化切片及专用深度学习方法的出现。已有多种自监督基础特征提取器被开发,可支持从细胞分割到肿瘤亚型分类和生存分析等下游任务。相比之下,专为病理学设计的生成式基础模型仍十分稀缺。这类模型可解决特征提取器难以处理的任务,如虚拟染色。本文提出CytoSyn,一种先进的基础潜空间扩散模型,能够生成高度真实且多样化的病理H&E染色图像。我们通过方法改进、数据集扩展、采样策略优化及滑片级过拟合控制,推出性能更优的CytoSyn-v2,并与当前先进模型PixCell进行了深入对比。结果表明,两类扩散模型及其评估指标对预处理细节(如JPEG压缩)极为敏感。模型在超过10,000张TCGA诊断全切片图像(涵盖32种癌症类型)上训练,尽管仅使用肿瘤切片,仍可生成炎症性肠病图像,展现强大泛化能力。为支持科研社区,我们公开发布CytoSyn的权重、训练与验证数据集及部分合成图像:https://huggingface.co/Owkin-Bioptimus/CytoSyn。
原文摘要 · Abstract (English)
Computational pathology has made significant progress in recent years, fueling advances in both fundamental disease understanding and clinically ready tools. This evolution is driven by the availability of large amounts of digitized slides and specialized deep learning methods and models. Multiple self-supervised foundation feature extractors have been developed, enabling downstream predictive applications from cell segmentation to tumor sub-typing and survival analysis. In contrast, generative foundation models designed specifically for histopathology remain scarce. Such models could address tasks that are beyond the capabilities of feature extractors, such as virtual staining. In this paper, we introduce CytoSyn, a state-of-the-art foundation latent diffusion model that enables the guided generation of highly realistic and diverse histopathology H&E-stained images, as shown in an extensive benchmark. We explored methodological improvements, training set scaling, sampling strategies and slide-level overfitting, culminating in the improved CytoSyn-v2, and compared our work to PixCell, a state-of-the-art model, in an in-depth manner. This comparison highlighted the strong sensitivity of both diffusion models and performance metrics to preprocessing-specific details such as JPEG compression. Our model has been trained on a dataset obtained from more than 10,000 TCGA diagnostic whole-slide images of 32 different cancer types. Despite being trained only on oncology slides, it maintains state-of-the-art performance generating inflammatory bowel disease images. To support the research community, we publicly release CytoSyn's weights, its training and validation datasets, and a sample of synthetic images in this repository: https://huggingface.co/Owkin-Bioptimus/CytoSyn.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。