arXiv:2412.17767cs.CLcs.LG2024-12ICML被引 40

用AI模拟科研社区,自动生成跨学科研究灵感。

ResearchTown: Simulator of Human Research Community

  • 将研究人员和论文建模为图结构节点,通过文本推理实现协作模拟。
  • 可稳定运行多研究员、多论文的复杂科研场景。
  • 生成的跨领域想法或能启发开创性研究方向,适合科研探索者。

大型语言模型在科学领域展现出巨大潜力,但一个根本问题仍待解答:能否用大模型模拟人类科研共同体?回答此问题有助于深化对创意生成过程的理解,并推动自动发现新颖科学洞见。本文提出ResearchTown,一种用于科研共同体仿真的多智能体框架。该框架将科研共同体简化为一个代理-数据图,其中研究人员和论文分别表示为代理型与数据型节点,并基于合作关系连接。我们还引入TextGNN,一种基于文本的推理框架,将论文阅读、撰写、评审等研究活动统一建模为图上的消息传递过程。为评估仿真质量,我们构建了ResearchBench基准,基于节点掩码预测任务进行可扩展、客观的评估。实验揭示三个关键发现:(1) ResearchTown可真实模拟协作科研行为,包括论文撰写与评审;(2) 能够在多研究员与多样化论文环境下保持稳健仿真;(3) 可生成具有潜力的跨学科研究思路,或启发开创性研究方向。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated remarkable potential in scientific domains, yet a fundamental question remains unanswered: Can we simulate human research communities with LLMs? Addressing this question can deepen our understanding of the processes behind idea brainstorming and inspire the automatic discovery of novel scientific insights. In this work, we propose ResearchTown, a multi-agent framework for research community simulation. Within this framework, the human research community is simplified as an agent-data graph, where researchers and papers are represented as agent-type and data-type nodes, respectively, and connected based on their collaboration relationships. We also introduce TextGNN, a text-based inference framework that models various research activities (e.g., paper reading, paper writing, and review writing) as special forms of a unified message-passing process on the agent-data graph. To evaluate the quality of the research community simulation, we present ResearchBench, a benchmark that uses a node-masking prediction task for scalable and objective assessment based on similarity. Our experiments reveal three key findings: (1) ResearchTown can provide a realistic simulation of collaborative research activities, including paper writing and review writing; (2) ResearchTown can maintain robust simulation with multiple researchers and diverse papers; (3) ResearchTown can generate interdisciplinary research ideas that potentially inspire pioneering research directions.

科研模拟多智能体跨学科

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。