arXiv:2502.07979cs.CV2025-02中稿 · Medical Image Anal…被引 5

联合建模组织形态与分子标志物,提升癌症分类精度。

Joint Modelling Histology and Molecular Markers for Cancer Classification

论文配图:Joint Modelling Histology and Molecular Markers for Cancer Classification
图 1 · 摘自论文原文
  • 多尺度解耦模块提取细胞到组织层级特征。
  • 同时预测病理与分子标志物,准确率超现有方法。
  • 适合精准肿瘤学研究与临床诊断参考。

癌症具有显著异质性和多样预后,精准分类对患者分层和临床决策至关重要。尽管数字病理学推动了癌症诊断与预后评估,但病理范式已从仅依赖组织形态转向融合分子标志物。亟需新的数字病理方法适应这一转变。本文提出一种新方法,联合预测分子标志物与组织形态特征,并建模其相互作用以实现癌症分类。首先,为缓解跨放大倍数信息传播问题,提出多尺度解耦模块,从高倍(细胞级)到低倍(组织级)全切片图像中提取多尺度特征。其次,基于多尺度特征,构建基于注意力的层次化多任务多实例学习框架,同步预测组织形态与分子标志物。此外,提出基于共现概率的标签相关性图网络,建模分子标志物间的共现关系。最后,设计跨模态交互模块,结合动态置信度约束损失与跨模态梯度调制策略,建模组织形态与分子标志物的交互。实验表明,该方法在胶质瘤分类、组织形态与分子标志物预测上均优于现有最先进方法。本方法有望推动精准肿瘤学发展,促进生物医学研究与临床应用。代码开源:https://github.com/LHY1007/M3C2。

原文摘要 · Abstract (English)

Cancers are characterized by remarkable heterogeneity and diverse prognosis. Accurate cancer classification is essential for patient stratification and clinical decision-making. Although digital pathology has been advancing cancer diagnosis and prognosis, the paradigm in cancer pathology has shifted from purely relying on histology features to incorporating molecular markers. There is an urgent need for digital pathology methods to meet the needs of the new paradigm. We introduce a novel digital pathology approach to jointly predict molecular markers and histology features and model their interactions for cancer classification. Firstly, to mitigate the challenge of cross-magnification information propagation, we propose a multi-scale disentangling module, enabling the extraction of multi-scale features from high-magnification (cellular-level) to low-magnification (tissue-level) whole slide images. Further, based on the multi-scale features, we propose an attention-based hierarchical multi-task multi-instance learning framework to simultaneously predict histology and molecular markers. Moreover, we propose a co-occurrence probability-based label correlation graph network to model the co-occurrence of molecular markers. Lastly, we design a cross-modal interaction module with the dynamic confidence constrain loss and a cross-modal gradient modulation strategy, to model the interactions of histology and molecular markers. Our experiments demonstrate that our method outperforms other state-of-the-art methods in classifying glioma, histology features and molecular markers. Our method promises to promote precise oncology with the potential to advance biomedical research and clinical applications. The code is available at https://github.com/LHY1007/M3C2

癌症分类数字病理多模态学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。