让病理图像诊断更符合临床逻辑,自动生成层次化诊断报告
TaxoMIL: Taxonomy-Constrained Learning for Hierarchical Whole Slide Image Analysis

- 将病理切片诊断转为分层文本生成任务,结合临床分类体系
- 在三个数据集上超越现有方法,准确率显著提升且避免错误层级关系
- 适合需要可解释、结构化病理诊断的医生和研究者
全切片图像(WSI)分析是计算病理学的核心,多实例学习(MIL)已成为滑片级诊断的标准流程。然而,传统方法将诊断视为离散标签的平坦分类任务,违背了临床推理固有的层次性与由粗到精特征。尽管近期的层次分类器和视觉-语言模型(VLMs)试图弥补这一结构差距,但它们或未能捕捉相关诊断间的语义连续性,或因无约束文本生成导致分类幻觉与父子标签冲突。为此,我们提出TaxoMIL,一种基于分类体系约束的框架,将WSI诊断重构为多粒度文本生成任务。TaxoMIL采用双头Transformer解码器生成粗粒度与细粒度诊断文本,并引入分类体系引导的目标函数,显式构建标签嵌入空间,严格将滑片级视觉表示锚定于临床分类体系中。在三个不同类型的WSI数据集上的大量实验表明,TaxoMIL持续优于当前最先进的MIL分类器与基于VLM的生成方法,产出准确且具备层次意识的诊断预测。代码已公开于https://github.com/QuIIL/TaxoMIL。
原文摘要 · Abstract (English)
Whole slide image (WSI) analysis is central to computational pathology, with multiple instance learning (MIL) emerging as the standard pipeline for slide-level diagnosis. However, conventional approaches formulate WSI diagnosis as a flat classification task over discrete labels, contradicting the inherently hierarchical, coarse-to-fine nature of clinical reasoning. Although recent hierarchical classifiers and vision-language models (VLMs) have sought to address this structural gap, they either fail to capture semantic continuity between related diagnoses or suffer from unconstrained text generation that produces taxonomic hallucinations and parent-child label violations. To address these limitations, we propose TaxoMIL, a taxonomy-constrained framework that reformulates WSI diagnosis as a multi-granularity text generation task. TaxoMIL utilizes a dual-head Transformer decoder to generate coarse- and fine-level diagnostic text, and introduces taxonomy-guided objectives that explicitly structure the label embedding space and strictly ground slide-level visual representations within the clinical taxonomy. Extensive experiments across three diverse WSI datasets demonstrate that TaxoMIL consistently outperforms state-of-the-art MIL classifiers and VLM-based generative methods, yielding accurate and hierarchy-aware diagnostic predictions. The code is released at https://github.com/QuIIL/TaxoMIL
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。