用新型模型提升病理切片分析效率与精度
PathRWKV: Enhancing Whole Slide Image Inference with Asymmetric Recurrent Modeling
- 采用非对称结构实现高效训练与恒定内存推理
- 在11个数据集上超越11种先进方法,准确率显著提升
- 适合医学图像分析、大规模病理切片处理场景
全切片成像(WSI)已成为癌症诊断的金标准,可从细胞到组织层面分析多尺度信息。由于GPU内存限制,直接处理整张WSI不可行,因此多实例学习(MIL)通过将WSI分割为小块成为主流方案。尽管近期两阶段MIL框架部分实现了内存效率,但仍存在四大局限:(1) 训练吞吐量与推理内存效率的矛盾;(2) 在小规模、稀疏标注的WSI数据集上易过拟合;(3) 基于采样的训练破坏空间结构完整性;(4) 长序列中多尺度特征交互建模不足。为此,我们提出PathRWKV,一种专为高效稳健的WSI分析设计的新状态空间模型。为解决计算权衡,提出非对称结构结合最大池化聚合,实现并行训练高吞吐与递归推理的恒定(O(1))内存复杂度。为缓解过拟合,采用随机采样增强数据多样性,并引入多任务学习模块正则化有限数据下的特征学习。为恢复空间上下文,引入二维正弦位置编码以感知组织块相对位置。为捕捉全面表征,集成TimeMix与ChannelMix模块,实现时间与空间维度上的动态多尺度特征建模。在涵盖29,073张WSI的11个数据集上实验表明,PathRWKV在10个数据集上优于11种前沿方法,展现出良好的可扩展性与应用潜力。
原文摘要 · Abstract (English)
Whole Slide Imaging (WSI) has become a gold standard in cancer diagnosis, inspecting multi-scale information from cellular to tissue levels. Processing an entire WSI directly is infeasible due to GPU memory constraints; thus, Multiple Instance Learning (MIL) has emerged as the standard solution by partitioning WSIs into tiles. While recent two-stage MIL frameworks partially achieve memory efficiency by decoupling tile-level extraction from slide-level modeling, they still face four limitations: (1) the conflict between training throughput and inference memory efficiency, (2) the high susceptibility to overfitting on small-scale WSI datasets with sparse supervision, (3) the disruption of spatial structural integrity during sampling-based training, and (4) the inadequate modeling of multi-scale feature interactions within long sequences. We therefore introduce PathRWKV, a novel State Space Model designed for efficient and robust WSI analysis. To resolve the computational trade-off, we propose an asymmetric structure utilizing max pooling aggregation, enabling parallelized training for high throughput and recurrent inference with constant (O(1)) memory complexity. To mitigate overfitting, we employ random sampling to enhance data diversity, with a multi-task learning module to regularize feature learning on limited data. To restore spatial context, we introduce 2D sinusoidal position encoding to perceive the relative locations of tissue tiles. To capture comprehensive representations, we integrate TimeMix and ChannelMix modules, enabling dynamic multi-scale feature modeling across temporal and spatial dimensions. Experiments on 29,073 WSIs across 11 datasets demonstrate that PathRWKV outperforms 11 state-of-the-art methods on 10 datasets, establishing it as a scalable and solution with application potential.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。