模型像医生一样只在难病例时调用第二意见,提升效率与准确率。
SecondOpinion: Anatomy-Aware Gated Reasoning for Efficient Medical Image Analysis

- 主干流快速处理所有图像,仅在需要时触发辅助的解剖导向流。
- 在胸片和骨盆骨折数据集上性能达最新水平,仅9.23%~45.71%的病例启用辅助流。
- 按病灶难易动态激活,适合医疗影像中需高效精准的场景。
医学影像分析中的深度学习模型通常对所有输入施加固定计算量。虽然解剖引导的双流架构能提升诊断性能,但其两个分支始终被无差别评估,即使单一流已可自信判断。本文提出SecondOpinion框架:快速主干流处理每例,而第二条解剖导向流仅当门控机制GateKeeper(被训练为二分类正确性判别器)判断主干流结果需额外审查时才被激活,类似临床医生对疑难病例寻求第二意见。激活后,两流通过轻量化交叉注意力模块融合。在统一五类胸片数据集和包含难以察觉骨折(需CT确认)的骨盆骨折数据集上评估,SecondOpinion在两项任务上达到或超越现有最优性能,且仅在9.23%的胸片病例、24.12%可见骨折、45.71%不可见骨折中激活辅助流,激活率与任务难度直接对应。结果表明,以正确性为目标监督门控信号,优于依赖未标注置信度,使解剖推理资源得以精准投放。
原文摘要 · Abstract (English)
Deep learning models for medical image analysis typically apply a fixed amount of computation to every input, regardless of case difficulty. Anatomy-guided dual-stream architectures have been shown to improve diagnostic performance, but they evaluate both streams unconditionally, even on cases a single stream could already resolve confidently. We propose SecondOpinion, a framework in which a fast primary stream processes every case, while a second, anatomy-guided stream is invoked only when GateKeeper, a gating mechanism trained explicitly as a binary correctness classifier, judges that the primary stream's prediction needs additional scrutiny, much as a clinician might seek a second opinion on a difficult case. When activated, the two streams are combined through a lightweight cross-attention fusion module. We evaluate SecondOpinion on a unified five-class chest X-ray dataset and a pelvic fracture dataset, the latter including a held-out, harder subset of fractures that are invisible on X-ray but confirmed via CT. SecondOpinion matches or exceeds prior state-of-the-art performance on both tasks, while activating its anatomy-guided stream on only 9.23% of chest X-ray cases, rising to 24.12% on visible fractures and 45.71% on invisible fractures, an activation rate that tracks task difficulty directly. These results suggest that supervising a gating signal toward correctness, rather than relying on unsupervised confidence, allows a model to allocate anatomical reasoning where it is actually needed.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。