用超图与状态空间模型结合,高效理解病理切片图像
Hypergraph Mamba for Efficient Whole Slide Image Understanding
- 将超图建模与状态空间模型融合,捕捉复杂空间关系
- 在多个数据集上表现优于Transformer,计算量降低7倍
- 适合需要高效处理高分辨率病理切片的医学AI研究者
组织病理学中的全切片图像(WSI)因超高分辨率、海量规模和复杂的空间关系,给大规模医学图像分析带来挑战。现有基于多重实例学习(MIL)的方法如图神经网络(GNN)和Transformer虽具备强实例建模能力,但存在可扩展性差和计算开销高的问题。为此,我们提出WSI-HGMamba框架,将超图神经网络(HGNN)的高阶关系建模能力与状态空间模型(SSM)的线性时间序列建模效率相结合。核心是HGMamba模块,集成消息传递、超图扫描与展平、双向状态空间建模(Bi-SSM),在保持关系与上下文信息的同时实现高效计算。相比Transformer和图变压器,在多个公开与私有WSI基准上性能更优,最高减少7倍浮点运算量(FLOPs)。实验证明该方法为滑片级理解提供了可扩展、准确且高效的解决方案,有望成为下一代病理AI系统的核心骨干。
原文摘要 · Abstract (English)
Whole Slide Images (WSIs) in histopathology pose a significant challenge for extensive medical image analysis due to their ultra-high resolution, massive scale, and intricate spatial relationships. Although existing Multiple Instance Learning (MIL) approaches like Graph Neural Networks (GNNs) and Transformers demonstrate strong instance-level modeling capabilities, they encounter constraints regarding scalability and computational expenses. To overcome these limitations, we introduce the WSI-HGMamba, a novel framework that unifies the high-order relational modeling capabilities of the Hypergraph Neural Networks (HGNNs) with the linear-time sequential modeling efficiency of the State Space Models. At the core of our design is the HGMamba block, which integrates message passing, hypergraph scanning & flattening, and bidirectional state space modeling (Bi-SSM), enabling the model to retain both relational and contextual cues while remaining computationally efficient. Compared to Transformer and Graph Transformer counterparts, WSI-HGMamba achieves superior performance with up to 7* reduction in FLOPs. Extensive experiments on multiple public and private WSI benchmarks demonstrate that our method provides a scalable, accurate, and efficient solution for slide-level understanding, making it a promising backbone for next-generation pathology AI systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。