arXiv:2604.15711cs.CVcs.AI2026-04

针对病理图像分析的细粒度特征提取难题,提出混合自监督模型SSMamba。

SSMamba: A Self-Supervised Hybrid State Space Model for Pathological Image Classification

论文配图:SSMamba: A Self-Supervised Hybrid State Space Model for Pathological Image Classification
图 1 · 摘自论文原文
  • 融合Mamba与ViT优势,分阶段进行自监督预训练与有监督微调。
  • 在10个公开病变区域数据集上超越11种顶尖模型,在6个全切片数据集上超越8种方法。
  • 特别适合需要高精度局部特征捕捉的医学影像诊断任务。

病理诊断高度依赖图像分析,其中感兴趣区域(ROIs)是诊断证据的主要来源,而全切片图像(WSI)级任务则侧重于聚合模式。为提取关键形态特征,基于视觉变换器(ViTs)和大规模自监督学习(SSL)的ROI级基础模型(FMs)被广泛应用。然而其在应用中仍存在三大核心局限:(1) 跨放大倍率域偏移,固定尺度预训练难以适应多样的临床场景;(2) 局部-全局关系建模不足,传统ViT骨干网络计算开销大且局部表征不精准;(3) 细粒度敏感性不足,传统自注意力机制易忽略细微诊断线索。为此,我们提出SSMamba,一种无需依赖大型外部数据集即可实现有效细粒度特征学习的混合自监督框架。该框架包含三个领域自适应组件:用于缓解域偏移的Mamba掩码图像建模(MAMIM),用于平衡局部-全局建模的方向多尺度(DMS)模块,以及提升细粒度敏感性的局部感知残差(LPR)模块。采用两阶段流程:在目标ROI数据集上进行自监督预训练,随后进行有监督微调(SFT)。实验表明,SSMamba在10个公开的ROI数据集上超越11种当前最优(SOTA)模型,在6个公开的WSI数据集上超越8种方法,验证了面向病理图像分析的任务特定架构设计的优势。

原文摘要 · Abstract (English)

Pathological diagnosis is highly reliant on image analysis, where Regions of Interest (ROIs) serve as the primary basis for diagnostic evidence, while whole-slide image (WSI)-level tasks primarily capture aggregated patterns. To extract these critical morphological features, ROI-level Foundation Models (FMs) based on Vision Transformers (ViTs) and large-scale self-supervised learning (SSL) have been widely adopted. However, three core limitations remain in their application to ROI analysis: (1) cross-magnification domain shift, as fixed-scale pretraining hinders adaptation to diverse clinical settings; (2) inadequate local-global relationship modeling, wherein the ViT backbone of FMs suffers from high computational overhead and imprecise local characterization; (3) insufficient fine-grained sensitivity, as traditional self-attention mechanisms tend to overlook subtle diagnostic cues. To address these challenges, we propose SSMamba, a hybrid SSL framework that enables effective fine-grained feature learning without relying on large external datasets. This framework incorporates three domain-adaptive components: Mamba Masked Image Modeling (MAMIM) for mitigating domain shift, a Directional Multi-scale (DMS) module for balanced local-global modeling, and a Local Perception Residual (LPR) module for enhanced fine-grained sensitivity. Employing a two-stage pipeline, SSL pretraining on target ROI datasets followed by supervised fine-tuning (SFT), SSMamba outperforms 11 state-of-the-art (SOTA) pathological FMs on 10 public ROI datasets and surpasses 8 SOTA methods on 6 public WSI datasets. These results validate the superiority of task-specific architectural designs for pathological image analysis.

病理图像自监督细粒度分析Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。