通过动态优化语义描述,提升病理切片少样本分类的准确率
MUSE: Harnessing Precise and Diverse Semantics for Few-Shot Whole Slide Image Classification
- 为每张切片定制细粒度语义描述,突破静态文本限制
- 在三个数据集上少样本分类精度超越现有方法,最高提升6.2%
- 适合需要高精度病理分析的医学AI研究者
在计算病理学中,少样本全切片图像分类主要受限于专家标注切片的极度稀缺。近期视觉-语言方法虽引入大模型生成的文本语义,但将其视为共享的静态类别先验,缺乏样本级细化,导致语义对齐的多样性和精确性不足,限制了有限监督下的泛化能力。为此,我们提出随机多视角语义增强框架MUSE:首先通过样本自适应机制提升语义精度,再借助检索增强的多视角生成丰富语义。具体地,MUSE引入样本级细粒度语义增强(SFSE),基于MoE的自适应视觉-语义交互为每张切片生成细粒度语义先验;在此基础上,随机多视角模型优化(SMMO)构建每类的LLM生成知识库,训练时检索并随机整合多个匹配文本视图。这些动态选择的文本作为增强语义监督,随机优化视觉-语言模型,提升鲁棒性并缓解过拟合。在三个基准全切片图像数据集上的实验表明,MUSE在少样本设置下持续优于现有视觉-语言基线,证明有效的少样本病理学习不仅需要更丰富的语义源,还需主动、样本感知的语义优化。
原文摘要 · Abstract (English)
In computational pathology, few-shot whole slide image classification is primarily driven by the extreme scarcity of expert-labeled slides. Recent vision-language methods incorporate textual semantics generated by large language models, but treat these descriptions as static class-level priors that are shared across all samples and lack sample-wise refinement. This limits both the diversity and precision of visual-semantic alignment, hindering generalization under limited supervision. To overcome this, we propose the stochastic MUlti-view Semantic Enhancement (MUSE), a framework that first refines semantic precision via sample-wise adaptation and then enhances semantic richness through retrieval-augmented multi-view generation. Specifically, MUSE introduces Sample-wise Fine-grained Semantic Enhancement (SFSE), which yields a fine-grained semantic prior for each sample through MoE-based adaptive visual-semantic interaction. Guided by this prior, Stochastic Multi-view Model Optimization (SMMO) constructs an LLM-generated knowledge base of diverse pathological descriptions per class, then retrieves and stochastically integrates multiple matched textual views during training. These dynamically selected texts serve as enriched semantic supervisions to stochastically optimize the vision-language model, promoting robustness and mitigating overfitting. Experiments on three benchmark WSI datasets show that MUSE consistently outperforms existing vision-language baselines in few-shot settings, demonstrating that effective few-shot pathology learning requires not only richer semantic sources but also their active and sample-aware semantic optimization. Our code is available at: https://github.com/JiahaoXu-god/CVPR2026_MUSE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。