arXiv:2507.02004cs.AIcs.CL2025-07

自进化AI助手可自动发现并整合生物医学工具,持续提升研究能力。

STELLA: Self-Evolving LLM Agent for Biomedical Research

  • 构建多智能体系统,通过模板库和工具海洋实现自我进化
  • 在多个生物医学评测中达到63%最高准确率,且随经验显著提升
  • 适合需要持续学习的科研自动化场景,尤其适合高复杂度文献分析

生物医学数据、工具和文献的快速增长导致研究环境高度碎片化,超出了人类专家的能力范围。尽管人工智能代理提供了解决方案,但通常依赖静态的人工维护工具集,难以适应和扩展。本文提出STELLA,一种自进化的AI代理,采用多智能体架构,通过两个核心机制自主提升自身能力:动态演化的推理策略模板库,以及由工具创建代理自动发现并集成新生物信息学工具的动态工具海洋。这使STELLA能够从经验中学习。实验表明,STELLA在多个生物医学基准测试中表现优异,人类最后考试:生物医学(Humanity's Last Exam: Biomedicine)得分约26%,LAB-Bench: DBQA得54%,LAB-Bench: LitQA得63%,领先于现有模型最多达6个百分点。更重要的是,其性能随使用次数系统性提升,例如在人类最后考试基准上,随着试验次数增加,准确率几乎翻倍。STELLA代表了可学习、可扩展的AI代理系统的重要进展,有望加速生物医学发现进程。

原文摘要 · Abstract (English)

The rapid growth of biomedical data, tools, and literature has created a fragmented research landscape that outpaces human expertise. While AI agents offer a solution, they typically rely on static, manually curated toolsets, limiting their ability to adapt and scale. Here, we introduce STELLA, a self-evolving AI agent designed to overcome these limitations. STELLA employs a multi-agent architecture that autonomously improves its own capabilities through two core mechanisms: an evolving Template Library for reasoning strategies and a dynamic Tool Ocean that expands as a Tool Creation Agent automatically discovers and integrates new bioinformatics tools. This allows STELLA to learn from experience. We demonstrate that STELLA achieves state-of-the-art accuracy on a suite of biomedical benchmarks, scoring approximately 26\% on Humanity's Last Exam: Biomedicine, 54\% on LAB-Bench: DBQA, and 63\% on LAB-Bench: LitQA, outperforming leading models by up to 6 percentage points. More importantly, we show that its performance systematically improves with experience; for instance, its accuracy on the Humanity's Last Exam benchmark almost doubles with increased trials. STELLA represents a significant advance towards AI Agent systems that can learn and grow, dynamically scaling their expertise to accelerate the pace of biomedical discovery.

AI代理自进化生物医学多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。