arXiv:2504.01202cs.LG2025-04

分析病理报告模型的错误根源,找出哪些情况导致模型拒判

Global explainability of a deep abstaining classifier

  • 用1.3万条局部解释做降维,全局定位错误原因
  • 97%准确率下仅保留22%样本,多为常见明确类别
  • 适合想改进医疗模型拒判策略的研究者和医生

我们提出一种全局可解释性方法,用于分析基于MTCNN的深度拒判分类器(DAC)在癌症病理报告自动标注任务中的错误来源。该模型在104万份人工标注样本上训练并评估,同时预测癌症部位、亚部位、组织学类型、侧别和行为特征。DAC框架允许模型对模糊报告或混淆类别进行拒判,以实现目标准确率,但牺牲了覆盖率。要求组织学任务达到97%准确率时,仅保留22%样本,主要为非模糊且常见的类别。通过梯度输入法(GradInp)获得数千个个体预测的上下文推理,再对约1.3万条聚合局部解释进行降维,识别出错误的四大来源:类别层级复杂性、标签噪声、信息不足以及矛盾证据。这提示可通过排除标准、聚焦标注和降低层级相关类别错误惩罚等策略,持续优化该复杂现实场景下的DAC系统。

原文摘要 · Abstract (English)

We present a global explainability method to characterize sources of errors in the histology prediction task of our real-world multitask convolutional neural network (MTCNN)-based deep abstaining classifier (DAC), for automated annotation of cancer pathology reports from NCI-SEER registries. Our classifier was trained and evaluated on 1.04 million hand-annotated samples and makes simultaneous predictions of cancer site, subsite, histology, laterality, and behavior for each report. The DAC framework enables the model to abstain on ambiguous reports and/or confusing classes to achieve a target accuracy on the retained (non-abstained) samples, but at the cost of decreased coverage. Requiring 97% accuracy on the histology task caused our model to retain only 22% of all samples, mostly the less ambiguous and common classes. Local explainability with the GradInp technique provided a computationally efficient way of obtaining contextual reasoning for thousands of individual predictions. Our method, involving dimensionality reduction of approximately 13000 aggregated local explanations, enabled global identification of sources of errors as hierarchical complexity among classes, label noise, insufficient information, and conflicting evidence. This suggests several strategies such as exclusion criteria, focused annotation, and reduced penalties for errors involving hierarchically related classes to iteratively improve our DAC in this complex real-world implementation.

可解释性医学图像拒判模型病理分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。