用粗到精方法生成可控的病理图像语义掩码,提升合成图像多样性与真实性。
PriorPath: Coarse-To-Fine Approach for Controlled De-Novo Pathology Semantic Masks Generation
- 从粗粒度图像逐步生成精细语义掩码,实现对组织空间分布的精准控制。
- 在皮肤、前列腺和肺癌三类癌症上覆盖更完整的掩码空间,优于已有方法。
- 可同时生成逼真掩码与图像,适合需要定制化病理数据的研究者使用。
将人工智能引入数字病理学有望自动化并提升图像分析与诊断流程。然而,组织样本的多样性及精细标注需求常导致数据集偏差,限制训练算法的应用范围。为应对这一挑战,利用合成组织病理图像至关重要,不仅需生成逼真图像,还需控制其细胞特征。以往方法从随机噪声生成捕捉组织空间分布的语义掩码,再作为先验用于条件生成模型以产出真实感图像。但此类生成模型常出现模式坍缩,无法充分捕捉数据分布的多样性。本文提出名为PriorPath的流水线,通过粗粒度图像生成详细且真实的语义掩码,从而控制生成掩码的空间布局,进而影响合成图像。我们在皮肤癌、前列腺癌和肺癌三种癌症上验证了该方法的有效性,证明其能更全面覆盖语义掩码空间,并在相似性上优于先前方法。本方案支持指定期望的组织分布,可在单一平台内生成高保真掩码与图像,为计算病理学中的人工智能提供最先进的可控图像生成解决方案。
原文摘要 · Abstract (English)
Incorporating artificial intelligence (AI) into digital pathology offers promising prospects for automating and enhancing tasks such as image analysis and diagnostic processes. However, the diversity of tissue samples and the necessity for meticulous image labeling often result in biased datasets, constraining the applicability of algorithms trained on them. To harness synthetic histopathological images to cope with this challenge, it is essential not only to produce photorealistic images but also to be able to exert control over the cellular characteristics they depict. Previous studies used methods to generate, from random noise, semantic masks that captured the spatial distribution of the tissue. These masks were then used as a prior for conditional generative approaches to produce photorealistic histopathological images. However, as with many other generative models, this solution exhibits mode collapse as the model fails to capture the full diversity of the underlying data distribution. In this work, we present a pipeline, coined PriorPath, that generates detailed, realistic, semantic masks derived from coarse-grained images delineating tissue regions. This approach enables control over the spatial arrangement of the generated masks and, consequently, the resulting synthetic images. We demonstrated the efficacy of our method across three cancer types, skin, prostate, and lung, showcasing PriorPath's capability to cover the semantic mask space and to provide better similarity to real masks compared to previous methods. Our approach allows for specifying desired tissue distributions and obtaining both photorealistic masks and images within a single platform, thus providing a state-of-the-art, controllable solution for generating histopathological images to facilitate AI for computational pathology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。