arXiv:2606.18749cs.CV2026-06

用2D模型无训练检测3D医学图像异常,通过切片拼接定位病灶。

Toward Training-Free Zero-Shot Anomaly Detection in 3D Medical Images: A Batch-Based Approach Using 2D Foundation Models

论文配图:Toward Training-Free Zero-Shot Anomaly Detection in 3D Medical Images: A Batch-Based Approach Using 2D Foundation Models
图 1 · 摘自论文原文
  • 将3D影像沿解剖轴切片,用2D模型逐片编码后聚合为体素特征
  • 基于跨患者相似性评分,差异大的区域判定为异常,灵敏度达87.6%
  • 适合无标注数据的临床场景,尤其对高对比度病灶效果显著

零样本异常检测(ZSAD)在医学影像中极具吸引力,因临床系统需应对异构成像协议、不断变化的患者群体以及缺乏标注数据的病灶。现有方法多针对2D图像,直接扩展至3D医学体积受限于大规模体积分层基础模型稀缺或难以利用体空间上下文。本文提出CS3F,一种无需训练的批量框架,利用2D基础模型实现3D医学图像的ZSAD。将每一体积沿多个解剖轴分解,使用2D视觉变换器逐切片编码,并通过池化邻近切片特征转换为局部体素标记。异常分数基于跨受试者互相似性:在其他受试者中缺乏近似匹配的标记被赋予更高异常分数。为缓解深度池化导致的病灶信号衰减,引入粗到细的标记化策略,在不进行全量匹配的前提下实现细粒度体素评分。在脑MRI上评估了转移瘤、胶质瘤和中风,在肺部CT上验证了超越脑部图谱对齐的泛化能力。结果表明,冻结的2D基础模型可在3D医学图像中支持异常定位,且细粒度标记化的收益高度依赖病灶对比度与成像模态。

原文摘要 · Abstract (English)

Zero-shot anomaly detection (ZSAD) is attractive for medical imaging because clinical systems must handle heterogeneous acquisition protocols, changing patient populations, and pathologies for which annotated training data may be unavailable. Most existing zero-shot anomaly detection methods are designed for 2D images, and their direct extension to 3D medical volumes is limited by the scarcity of large-scale volumetric foundation models or by the difficulty of utilizing volumetric context. We propose CS3F, a training-free batch-based framework for ZSAD in 3D medical images using 2D foundation models. Each volume is decomposed along multiple anatomical axes and encoded slice-wise by a 2D vision transformer. These are then converted into localized volumetric tokens by pooling neighboring slice features. Anomaly scores are obtained from cross-subject mutual similarity: tokens that lack close analogues in other subjects are assigned higher anomaly scores. To reduce the attenuation of focal lesion signals caused by depth pooling, we introduce a coarse-to-fine tokenization strategy that enables fine-resolution volumetric scoring without exhaustive matching. CS3F is evaluated on brain MRI across metastases, glioma, and stroke, as well as validated on lung CT to test generalizability beyond atlas-aligned brain MRI. The results show that frozen 2D foundation models can support anomaly localization in 3D medical images, and that the benefit of fine tokenization depends strongly on lesion contrast and imaging modality.

异常检测3D医学影像2D模型无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。