无需训练即可检测病理切片异常,提升AI医疗安全性
Training-Free Out-of-Distribution Detection for Pathology Whole-Slide Images

- 利用视觉与语言模型构建多模态原型,通过原型压缩生成异常评分
- 在超1.4万张独立病理切片上优于40种先进方法,涵盖罕见病等复杂场景
- 适合追求安全部署的临床AI研发者,尤其适用于无标注数据环境
医学AI的安全部署需具备识别输入数据偏离训练分布的能力,以确保模型仅在专业范围内作出预测并拒绝不确定情况。出域(OOD)检测可提供此类保障,在通用计算机视觉中已广泛研究,但在计算病理学中仍不成熟。病理全切片图像(WSIs)具有千兆像素级分辨率、疾病亚型间差异细微以及组织制备变异大等特点,给传统方法带来挑战。本文提出ZIO,一种无需训练的多模态病理OOD检测方法,利用视觉-语言病理基础模型(FMs)。ZIO构建类内文本与视觉原型,并通过原型压缩机制融合互补信息,生成OOD分数。该方法支持切片级与局部块级基础模型。我们在多种临床相关域偏移场景下评估,包括罕见病及近似出域情形。对来自五个独立联盟的超过14,700张WSI进行的全面评估显示,ZIO始终优于单模态原型及40种前沿OOD方法。结果证明多模态表征在OOD检测中的优势,为临床实践中更安全的AI部署铺平道路。
原文摘要 · Abstract (English)
Safe deployment of AI methods in medicine requires robust guardrails that detect when input data deviate from the training distribution to ensure that models provide predictions only within their scope of expertise and abstain otherwise. Out-of-distribution (OOD) detection can provide such safeguards and is extensively studied in general computer vision. Yet, it remains underdeveloped in computational pathology, where gigapixel whole-slide images (WSIs), subtle differences between disease subtypes, and variability in tissue preparation pose unique challenges for conventional OOD methods. We propose ZIO, a training-free, multimodal OOD detector for pathology WSIs that leverages vision--language pathology foundation models (FMs). ZIO constructs text and visual prototypes of in-distribution classes and integrates their complementary information through a prototype shrinkage mechanism to derive OOD scores. We provide the ZIO formulation for both slide- and patch-level FMs. We evaluate ZIO across diverse clinically relevant domain shifts, including rare diseases and near-OOD settings. Extensive evaluation of over 14,700 WSIs from five independent consortia shows that ZIO consistently outperforms both unimodal prototypes and 40 state-of-the-art OOD methods. These results demonstrate the benefits of multimodal representation for OOD detection and pave the way towards safer AI deployment in clinical practice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。