arXiv:2607.11257cs.CVcs.LG2026-07

用病理报告语言指导模型,让小模型也能高效精准分析病理切片。

LaGuadia: Language-Guided Adaptive Distillation from Pathology Foundation Models

论文配图:LaGuadia: Language-Guided Adaptive Distillation from Pathology Foundation Models
图 1 · 摘自论文原文
  • 根据临床报告提取关键词,动态分配多个大模型的贡献权重。
  • 8700万参数的小模型在多项任务上媲美大模型,准确率超基准。
  • 适合需要轻量化、高可靠性的数字病理系统开发者使用。

病理基础模型(PFMs)虽能生成高质量的全幻灯片图像(WSI)表征,但计算开销巨大。现有知识蒸馏方法多采用固定权重,忽视组织异质性。我们提出LaGuadia(语言引导自适应蒸馏),通过临床语言指导,从多个PFM中动态整合知识,构建紧凑的病理图像编码器。流程分三步:首先从病理报告中提取视觉可感知的临床关键词;其次利用视觉-语言元教师MedSigLIP将视觉特征与关键词对齐,提供细粒度语义引导;最后执行自适应蒸馏,根据教师模型与临床描述的语义匹配度调整其贡献权重。在全幻灯片图像描述、视觉问答和切片级分类任务上,一个8700万参数的LaGuadia学生模型表现优于或相当基线模型(如GigaPath、UNI),具备强事实一致性和鲁棒泛化能力。结果表明,临床语言是构建高效可靠数字病理系统的关键语义锚点。代码已开源:https://github.com/hvcl/LaGuadia。

原文摘要 · Abstract (English)

Pathology Foundation Models (PFMs) offer powerful Whole Slide Image (WSI) representations but suffer from massive computational costs. While Knowledge Distillation (KD) can create efficient student models, existing multi-teacher methods often use suboptimal uniform weighting that ignores tissue heterogeneity. We propose LaGuadia (Language-Guided Adaptive DistillAtion), a framework that develops a compact pathology image encoder by dynamically integrating expertise from multiple PFMs under clinical linguistic guidance. Our approach utilizes a multi-stage pipeline: first, extracting visually observable clinical keywords from pathology reports; second, aligning visual features with these keywords via a Vision-Language meta-teacher (MedSigLIP) to provide dense semantic guidance; and finally, performing adaptive KD where teacher contributions are weighted based on their semantic alignment with the clinical narrative. Experiments on WSI captioning, visual question answering, and slide-level classification tasks demonstrate that an 87M parameter LaGuadia student model matches or exceeds foundation-scale models such as GigaPath and UNI, achieving strong factual consistency and robust generalization. These results highlight clinical language as an effective semantic anchor for building efficient and reliable digital pathology systems. Code is available at https://github.com/hvcl/LaGuadia.

病理分析知识蒸馏视觉语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。