用多智能体模拟真实问诊,让大模型边互动边改进诊断能力。
Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactions
- 构建医生、患者、检查员三类智能体,模拟多轮问诊与检验流程。
- 通过自我迭代优化诊断策略,提升大模型在动态场景中的表现。
- 支持自动与人机交互模式,适合医疗AI评估与训练使用。
本文提出MedAgentSim,一个开源的模拟临床环境,包含医生、患者和检测代理,用于评估和提升大语言模型在动态诊断场景中的表现。与以往方法不同,该框架要求医生代理通过多轮对话主动向患者询问相关医学检查(如体温、血压、心电图)和影像结果(如MRI、X光),并从检测代理获取信息,以模拟真实世界的诊断过程。同时,引入自我改进机制,使模型能够迭代优化诊断策略。我们通过集成多智能体讨论、思维链推理和基于经验的知识检索,提升大模型在模拟环境中的表现,推动医生代理在与更多患者交互中实现渐进式学习。此外,还构建了一个评估基准,用于衡量大模型在动态、上下文感知诊断互动中的能力。尽管MedAgentSim完全自动化,也支持用户控制模式,允许人类与医生或患者代理互动。在多种模拟诊断场景中的综合评估验证了该方法的有效性。代码、仿真工具和基准数据已公开于https://medagentsim.netlify.app/。
原文摘要 · Abstract (English)
In this work, we introduce MedAgentSim, an open-source simulated clinical environment with doctor, patient, and measurement agents designed to evaluate and enhance LLM performance in dynamic diagnostic settings. Unlike prior approaches, our framework requires doctor agents to actively engage with patients through multi-turn conversations, requesting relevant medical examinations (e.g., temperature, blood pressure, ECG) and imaging results (e.g., MRI, X-ray) from a measurement agent to mimic the real-world diagnostic process. Additionally, we incorporate self improvement mechanisms that allow models to iteratively refine their diagnostic strategies. We enhance LLM performance in our simulated setting by integrating multi-agent discussions, chain-of-thought reasoning, and experience-based knowledge retrieval, facilitating progressive learning as doctor agents interact with more patients. We also introduce an evaluation benchmark for assessing the LLM's ability to engage in dynamic, context-aware diagnostic interactions. While MedAgentSim is fully automated, it also supports a user-controlled mode, enabling human interaction with either the doctor or patient agent. Comprehensive evaluations in various simulated diagnostic scenarios demonstrate the effectiveness of our approach. Our code, simulation tool, and benchmark are available at \href{https://medagentsim.netlify.app/}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。