arXiv:2603.00123cs.CVcs.AI2026-03

让AI像医生一样分步操作CT影像,自动调用测量分割工具。

CT-Flow: Orchestrating CT Interpretation Workflow with Model Context Protocol Servers

  • 用模型上下文协议实现可交互的3D CT分析流程
  • 在诊断准确率上比基线提升41%,工具调用成功率95%
  • 适合研究医疗AI工作流与智能临床助手的开发者

大型视觉语言模型在多模态医学推理中展现出潜力,尤其在诊断视觉问答和报告生成任务中。然而,现有3D CT分析方法大多依赖静态单次推理。临床解读是动态、工具辅助的过程,需反复查看切片并使用测量、放射组学和分割工具来优化判断。为此,我们提出CT-Flow,一种面向体数据解读的代理式框架,通过模型上下文协议(MCP)实现开放、工具感知的分析范式。我们构建了首个针对3D CT工具使用与多步推理的大规模指令微调基准测试集CT-FlowBench。基于此,CT-Flow可将复杂自然语言查询分解为自动化工具调用序列。在CT-FlowBench和标准3D VQA数据集上的实验表明,该框架达到当前最优性能,诊断准确率较基线提升41%,自主工具调用成功率达95%。本工作为将自主代理智能集成到真实临床放射科提供了可扩展基础。

原文摘要 · Abstract (English)

Recent advances in Large Vision-Language Models (LVLMs) have shown strong potential for multi-modal radiological reasoning, particularly in tasks like diagnostic visual question answering (VQA) and radiology report generation. However, most existing approaches for 3D CT analysis largely rely on static, single-pass inference. In practice, clinical interpretation is a dynamic, tool-mediated workflow where radiologists iteratively review slices and use measurement, radiomics, and segmentation tools to refine findings. To bridge this gap, we propose CT-Flow, an agentic framework designed for interoperable volumetric interpretation. By leveraging the Model Context Protocol (MCP), CT-Flow shifts from closed-box inference to an open, tool-aware paradigm. We curate CT-FlowBench, the first large-scale instruction-tuning benchmark tailored for 3D CT tool-use and multi-step reasoning. Built upon this, CT-Flow functions as a clinical orchestrator capable of decomposing complex natural language queries into automated tool-use sequences. Experimental evaluations on CT-FlowBench and standard 3D VQA datasets demonstrate that CT-Flow achieves state-of-the-art performance, surpassing baseline models by 41% in diagnostic accuracy and achieving a 95% success rate in autonomous tool invocation. This work provides a scalable foundation for integrating autonomous, agentic intelligence into real-world clinical radiology.

医学影像智能诊断多模态代理系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。