arXiv:2512.11682cs.AIcs.LG2025-12被引 2

医学智能体在真实治疗决策中展现强推理能力,获顶会卓越奖。

MedAI: Evaluating TxAgent's Therapeutic Agentic Reasoning in the NeurIPS CURE-Bench Competition

  • 用动态工具调用+检索增强生成实现多步医疗推理。
  • 改进工具检索策略后,治疗推荐准确率显著提升。
  • 适合医疗AI研究者与临床辅助系统开发者参考。

临床治疗决策是高风险领域,要求AI具备基于可靠生物医学知识的多步推理能力。本文参与NeurIPS 2025 CURE-Bench竞赛,评估名为TxAgent的医学智能体,其基于微调的Llama-3.1-8B模型,通过动态调用统一生物医学工具套件(ToolUniverse)——集成FDA Drug API、OpenTargets和Monarch资源——实现药物推荐、治疗方案制定与不良反应预测。相比通用RAG系统,医疗场景对推理路径与工具调用序列的准确性要求更高,因此本研究将逐标记推理过程与工具使用行为作为显式监督信号。实验分析了工具调用检索质量对整体性能的影响,并验证了优化检索策略带来的性能增益。研究成果荣获开放科学卓越奖,详细信息见https://curebench.ai/。

原文摘要 · Abstract (English)

Therapeutic decision-making in clinical medicine constitutes a high-stakes domain in which AI guidance interacts with complex interactions among patient characteristics, disease processes, and pharmacological agents. Tasks such as drug recommendation, treatment planning, and adverse-effect prediction demand robust, multi-step reasoning grounded in reliable biomedical knowledge. Agentic AI methods, exemplified by TxAgent, address these challenges through iterative retrieval-augmented generation (RAG). TxAgent employs a fine-tuned Llama-3.1-8B model that dynamically generates and executes function calls to a unified biomedical tool suite (ToolUniverse), integrating FDA Drug API, OpenTargets, and Monarch resources to ensure access to current therapeutic information. In contrast to general-purpose RAG systems, medical applications impose stringent safety constraints, rendering the accuracy of both the reasoning trace and the sequence of tool invocations critical. These considerations motivate evaluation protocols treating token-level reasoning and tool-usage behaviors as explicit supervision signals. This work presents insights derived from our participation in the CURE-Bench NeurIPS 2025 Challenge, which benchmarks therapeutic-reasoning systems using metrics that assess correctness, tool utilization, and reasoning quality. We analyze how retrieval quality for function (tool) calls influences overall model performance and demonstrate performance gains achieved through improved tool-retrieval strategies. Our work was awarded the Excellence Award in Open Science. Complete information can be found at https://curebench.ai/.

医学AI智能体推理工具调用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。