让超声诊断既有精准定位又有可靠推理,突破现有AI模型短板。
Echo-α: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretation

- 用调用-推理框架整合器官检测器与全局视觉,实现联合分析
- 跨中心测试中肾/乳腺超声诊断准确率分别达74.90%/49.20%
- 适合临床部署,提升AI超声系统的可解释性与泛化能力
超声解读需兼顾病灶精确定位与整体临床推理,但现有方法通常只擅长其一:专用检测器定位强但推理弱,多模态大语言模型推理灵活却缺乏医学领域实证。我们提出Echo-α,一种面向超声解读的代理式多模态推理模型,通过调用-推理框架统一二者优势。该模型训练时协调器官特异性检测器输出,融合全局视觉上下文,并将证据转化为有依据的诊断决策,超越仅依赖检测器的推断。这一行为通过九任务监督课程建立,并在不同奖励权衡下经序列强化学习优化,形成用于病灶锚定的Echo-α-Grounding和用于最终诊断的Echo-α-Diagnosis。在多中心肾及乳腺超声基准测试中,Echo-α在定位与诊断上均优于对比模型。尤其在跨中心测试集上,Echo-α-Grounding的[email protected]分别为56.73%和43.78%,而Echo-α-Diagnosis的总体准确率分别达到74.90%和49.20%。结果表明,代理式多模态推理可使专用检测器转化为可验证的临床证据,为构建更准确、可解释且可迁移的超声AI系统提供实用路径。代码库见https://github.com/MiliLab/Echo-Alpha。
原文摘要 · Abstract (English)
Ultrasound interpretation requires both precise lesion localization and holistic clinical reasoning, yet existing methods typically excel at only one of these capabilities: specialized detectors offer strong localization but limited reasoning, whereas multimodal large language models (MLLMs) provide flexible reasoning but weak grounding in specialized medical domains. We present Echo-α, an agentic multimodal reasoning model for ultrasound interpretation that unifies these strengths within an invoke-and-reason framework. Echo-α is trained to coordinate organ-specific detector outputs, integrate them with global visual context, and convert the resulting evidence into grounded diagnostic decisions beyond detector-only inference. This behavior is established through a nine-task supervised curriculum and then refined by sequential reinforcement learning under different reward trade-offs, yielding Echo-α-Grounding for lesion anchoring and Echo-α-Diagnosis for final diagnosis. On multi-center renal and breast ultrasound benchmarks, Echo-α outperforms competitive baselines on both grounding and diagnosis. In particular, on cross-center test sets, Echo-α-Grounding attains 56.73%/43.78% [email protected] and Echo- α-Diagnosis reaches 74.90%/49.20% overall accuracy on renal/breast ultrasound. These results suggest that agentic multimodal reasoning can turn specialized detectors into verifiable clinical evidence, offering a practical route toward ultrasound AI systems that are more accurate, interpretable, and transferable. The repository is at https://github.com/MiliLab/Echo-Alpha.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。