通过细胞与组织的交互建模,提升病理图像细粒度分类精度
ITC-RWKV: Interactive Tissue-Cell Modeling with Recurrent Key-Value Aggregation for Histopathological Subtyping
- 双流架构融合组织与细胞层级特征,用递归键值聚合高效捕捉细胞间关系
- 在4个基准数据集上优于现有模型,细胞级特征聚合显著提升分类性能
- 适合需要细粒度癌症分型的病理分析研究者,尤其关注细胞-组织互动机制
准确解读病理图像需整合从核形态、细胞纹理到整体组织结构和疾病特异性模式的多尺度信息。尽管近期病理领域基础模型在捕捉全局组织上下文方面表现强劲,但其忽略细胞层级特征建模,限制了细粒度任务如癌症亚型分类的性能。为此,我们提出一种双流架构,建模宏观组织特征与聚合细胞表示之间的相互作用。为高效聚合大量细胞信息,我们设计了一种具有线性复杂度的可接受权重键值聚合模型,该模型基于递归变压器捕捉细胞间依赖关系。此外,引入双向组织-细胞交互模块,实现局部细胞线索与其周围组织环境间的互注意力。在四个病理亚型分类基准上的实验表明,所提方法优于现有模型,验证了细胞级聚合与组织-细胞交互在细粒度计算病理学中的关键作用。
原文摘要 · Abstract (English)
Accurate interpretation of histopathological images demands integration of information across spatial and semantic scales, from nuclear morphology and cellular textures to global tissue organization and disease-specific patterns. Although recent foundation models in pathology have shown strong capabilities in capturing global tissue context, their omission of cell-level feature modeling remains a key limitation for fine-grained tasks such as cancer subtype classification. To address this, we propose a dual-stream architecture that models the interplay between macroscale tissue features and aggregated cellular representations. To efficiently aggregate information from large cell sets, we propose a receptance-weighted key-value aggregation model, a recurrent transformer that captures inter-cell dependencies with linear complexity. Furthermore, we introduce a bidirectional tissue-cell interaction module to enable mutual attention between localized cellular cues and their surrounding tissue environment. Experiments on four histopathological subtype classification benchmarks show that the proposed method outperforms existing models, demonstrating the critical role of cell-level aggregation and tissue-cell interaction in fine-grained computational pathology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。