基于报告自动生成解剖路由,提升小病灶3D肺部CT识别准确率
ARC-CT: Anatomy-Routed Contrastive Vision-Language Learning for 3D Chest CT

- 用器官掩码约束查询,定位病灶区域证据
- 0.86宏AUC,超越高效基线与大模型
- 仅靠报告提取标签,无需人工标注
对比视觉语言学习通过配对的胸部CT体积与放射科报告,无需人工标注即可学习异常分类器。然而,胸部CT的两个特性挑战了传统的全局对比学习:首先,许多关键异常较小或解剖位置特定,将整个体积池化为单一嵌入可能稀释其视觉证据;其次,标准对比目标将批次中每张扫描视为负例,由于多份胸部CT共享异常,该目标错误地将共阳性对推开。我们提出针对3D胸部CT的解剖路由对比学习(ARC-CT),一种仅依赖大语言模型从报告中提取标签、无需人工标注或边界框的区域感知框架。ARC-CT包含三个组件:(1) AnatomyQFormer,通过由自动生成的器官掩码约束的查询定位证据;(2) 标签-杰卡德软InfoNCE损失,整合标准的独热目标与每对样本的标签集重叠,降低共享临床发现的研究之间的误罚;(3) 器官级对齐损失,将掩码池化视觉特征连接至离线使用大语言模型提取的器官特异性报告文本。使用紧凑的3D ResNet-18主干网络,ARC-CT在18种异常上实现了0.86的无掩码宏AUC,整体性能优于多个高效基线及更大规模的Transformer模型。
原文摘要 · Abstract (English)
Contrastive vision-language learning uses paired chest CT volumes and radiology reports to learn abnormality classifiers without manually annotated labels. However, two characteristics of chest CT challenge conventional global contrastive learning. First, many critical abnormalities are small or anatomically localized, and pooling an en- tire volume into a single embedding may dilute their visual evidence. Second, the standard contrastive objective treats every other scan in a batch as a negative. Because many chest CTs share abnormalities, this objective incorrectly pushes co-positive pairs apart. We propose Anatomy-Routed Contrastive Learning for 3D Chest CT (ARC-CT), a region-aware framework that addresses these limitations using only la- bels extracted from reports by an LLM, with no manual annotations or bounding boxes. ARC-CT combines three components: (1) an Anato- myQFormer localizing evidence via queries constrained by automatically generated organ masks; (2) a label-Jaccard soft InfoNCE objective in- tegrating the standard one-hot target with the label-set overlap of each pair, which reduces false-negative penalties between studies that share clinical findings; and (3) an organ-level alignment loss connecting mask- pooled visual features to organ-specific report text extracted offline with a large language model. ARC-CT achieves a 0.86 mask-free macro AUC across 18 abnormalities using a compact 3D ResNet-18 backbone. Over- all, ARC-CT outperforms both comparable efficient baselines and sev- eral larger transformer models. Our code and weights are available at https://github.com/arc-ct/arc-ct.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。