arXiv:2412.16715cs.CVcs.AI2024-12被引 2

构建超大细胞标注数据集,用分层变压器模型分析病理切片中细胞空间分布。

From Histopathology Images to Cell Clouds: Learning Slide Representations with Hierarchical Cell Transformer

  • 将病理切片转为细胞云,分层建模细胞间空间关系
  • 在50亿细胞标注数据上实现生存预测与分期的领先性能
  • 适合病理分析、肿瘤预后研究者参考

临床中直接分析组织切片中细胞的空间分布至关重要且潜力巨大。然而,现有全切片图像(WSI)数据集普遍缺乏细胞级标注,因超像素图像标注成本极高。本文构建了包含超过50亿细胞标注的大规模数据集WSI-Cell5B,基于11种癌症的6,998张来自癌症基因组图谱(TCGA)的WSI,每张图均以坐标和类型进行逐细胞标注。据我们所知,这是首个整合细胞级标注的全切片图像大规模数据集。同时提出分层细胞云变压器(CCFormer),将每张切片中的细胞集合视为细胞云,通过邻域信息嵌入(NIE)刻画每个细胞周围分布,并设计分层空间感知(HSP)模块自底向上学习细胞间空间关系。临床分析表明,该数据集可用于基于细胞计数的生存风险评估指标设计。大量实验显示,仅从细胞空间分布学习即可达到当前最优(SOTA)表现,CCFormer显著优于其他方法。

原文摘要 · Abstract (English)

It is clinically crucial and potentially very beneficial to be able to analyze and model directly the spatial distributions of cells in histopathology whole slide images (WSI). However, most existing WSI datasets lack cell-level annotations, owing to the extremely high cost over giga-pixel images. Thus, it remains an open question whether deep learning models can directly and effectively analyze WSIs from the semantic aspect of cell distributions. In this work, we construct a large-scale WSI dataset with more than 5 billion cell-level annotations, termed WSI-Cell5B, and a novel hierarchical Cell Cloud Transformer (CCFormer) to tackle these challenges. WSI-Cell5B is based on 6,998 WSIs of 11 cancers from The Cancer Genome Atlas Program, and all WSIs are annotated per cell by coordinates and types. To the best of our knowledge, WSI-Cell5B is the first WSI-level large-scale dataset integrating cell-level annotations. On the other hand, CCFormer formulates the collection of cells in each WSI as a cell cloud and models cell spatial distribution. Specifically, Neighboring Information Embedding (NIE) is proposed to characterize the distribution of cells within the neighborhood of each cell, and a novel Hierarchical Spatial Perception (HSP) module is proposed to learn the spatial relationship among cells in a bottom-up manner. The clinical analysis indicates that WSI-Cell5B can be used to design clinical evaluation metrics based on counting cells that effectively assess the survival risk of patients. Extensive experiments on survival prediction and cancer staging show that learning from cell spatial distribution alone can already achieve state-of-the-art (SOTA) performance, i.e., CCFormer strongly outperforms other competing methods.

病理图像细胞分布分层模型生存预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。