让大模型学会自主提出新颖科研想法,提升科学发现效率。
DeepInnovator: Triggering the Innovative Capabilities of LLMs
- 构建自动知识提取系统,从海量文献中整理结构化科研知识。
- 设计‘预测-评估-优化’迭代训练机制,显著提升想法创新性。
- 在专家评测中胜率超80%,效果接近顶尖大模型,适合科研助手开发。
大语言模型在加速科学发现中的应用日益受到关注,核心在于构建具备创新能力的研究代理,即自主生成新颖且重要的研究构想的能力。现有方法多依赖复杂的提示工程,缺乏系统性训练范式。为此,我们提出DeepInnovator,一种旨在激发大模型创新能力的训练框架。该框架包含两个核心组件:(1) ‘站在巨人的肩膀上’:构建自动化数据提取管道,从大规模无标注科学文献中提取并组织结构化研究知识;(2) ‘猜想与反驳’:引入‘下一个想法预测’训练范式,将研究想法生成建模为持续预测、评估和优化新想法的迭代过程。自动与专家评估均表明,DeepInnovator-14B显著优于未训练基线,在多个测试中胜率达80.53%–93.81%,性能接近当前领先的大语言模型。本工作为构建真正具有原创创新能力的研究代理提供了可扩展的训练路径,并将开源数据集以促进社区发展。源代码与数据见:https://github.com/HKUDS/DeepInnovator。
原文摘要 · Abstract (English)
The application of Large Language Models (LLMs) in accelerating scientific discovery has garnered increasing attention, with a key focus on constructing research agents endowed with innovative capability, i.e., the ability to autonomously generate novel and significant research ideas. Existing approaches predominantly rely on sophisticated prompt engineering and lack a systematic training paradigm. To address this, we propose DeepInnovator, a training framework designed to trigger the innovative capability of LLMs. Our approach comprises two core components. (1) ``Standing on the shoulders of giants''. We construct an automated data extraction pipeline to extract and organize structured research knowledge from a vast corpus of unlabeled scientific literature. (2) ``Conjectures and refutations''. We introduce a ``Next Idea Prediction'' training paradigm, which models the generation of research ideas as an iterative process of continuously predicting, evaluating, and refining plausible and novel next idea. Both automatic and expert evaluations demonstrate that our DeepInnovator-14B significantly outperforms untrained baselines, achieving win rates of 80.53\%-93.81\%, and attains performance comparable to that of current leading LLMs. This work provides a scalable training pathway toward building research agents with genuine, originative innovative capability, and will open-source the dataset to foster community advancement. Source code and data are available at: https://github.com/HKUDS/DeepInnovator.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。