arXiv:2506.04405cs.CLcs.AI2025-06被引 14

构建可扩展的医学代码推理训练环境,提升大模型处理生物医学数据能力。

MedAgentGym: A Scalable Agentic Training Environment for Code-Centric Reasoning in Biomedical Data Science

  • 基于7万多个任务实例构建交互式沙盒训练环境。
  • 使用强化学习使代理性能提升超43%,接近gpt-4o水平。
  • 适合开发医疗数据科学领域的智能编程助手。

我们提出MedAgentGym,一个可扩展且交互式的训练环境,旨在提升大语言模型(LLM)在生物医学数据科学中的代码驱动推理能力。该环境包含来自12个真实生物医学场景的72,413个任务实例,覆盖129个类别。每个任务均封装在可执行沙盒中,具备详细任务说明、实时反馈机制、可验证的真值标注及可扩展的训练轨迹生成能力。对29个LLM的广泛基准测试显示,商业与开源模型在生物医学数据科学任务上存在显著性能差异。通过在MedAgentGym中采用高效的多线程与多轮轨迹采样,Med-Copilot分别在离线与在线强化学习下获得+43.02%和+45.28%的性能提升,证明该平台是高效训练工具,并成为成本更低、隐私更安全且性能媲美专有模型(如gpt-4o)的替代方案。通过提供统一执行环境、全面基准与可扩展资源,MedAgentGym为开发基于LLM的医学数据科学编程助手提供了集成化平台。

原文摘要 · Abstract (English)

We introduce MedAgentGym, a scalable and interactive training environment designed to enhance coding-based biomedical reasoning capabilities in large language model (LLM) agents. MedAgentGym comprises 72,413 task instances across 129 categories derived from 12 authentic real-world biomedical scenarios. Tasks are encapsulated within executable sandbox environments, each featuring detailed task specifications, interactive feedback mechanisms, verifiable ground truth annotations, and scalable training trajectory generation. Extensive benchmarking of 29 LLMs reveals substantial performance disparities in biomedical data science between commercial and open-source LLMs. Leveraging efficient multi-threaded and multi-turn trajectory sampling in MedAgentGym, Med-Copilot achieves performance gains of +43.02% and +45.28% from offline and online reinforcement learning, respectively, demonstrating MedAgentGym as an effective training ground while establishing itself as a cost-effective, privacy-preserving alternative competitive with proprietary LLMs (gpt-4o). By offering a unified execution environment with a comprehensive benchmark and accessible, extensible training resources, MedAgentGym delivers an integrated platform to develop LLM-based coding assistants for advanced biomedical data science.

医学AI代码生成强化学习大模型训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。