AI学会科学判断力,能预测研究价值并提出高潜力课题。
AI Can Learn Scientific Taste
- 用社区反馈(如引用)训练AI判断研究价值
- 模型对未来论文的判断力优于现有大模型
- 适合希望加速科研创新的研究者与AI团队
科学发现依赖于专家判断力与远见,即所谓‘科学品味’:评估并提出具有长期科学影响力的潜在研究课题的能力。这种能力主要集中在少数资深研究人员中,且通常局限于特定领域。若AI能学习这种能力,将减少对人类专家的依赖,并加速科学发现进程。我们提出基于社区反馈的强化学习(RLCF),训练‘科学评判者’从引用等社区反馈中学习判断力,同时训练‘科学思考者’生成高潜力研究课题。实验表明,科学评判者性能优于强基线大模型,且其判断力可泛化至未来年份论文、其他社区指标及未见过的领域。此外,科学思考者提出的课题潜在影响力高于基线模型。结果表明,AI可学习科学品味,标志着迈向能助力科学发现的AI系统的重要一步。
原文摘要 · Abstract (English)
Scientific discovery depends on expert judgement and foresight, which we call scientific taste: the ability to judge and propose research ideas with the potential for long-term scientific impact. Scientific taste is largely concentrated among highly experienced researchers, whose expertise is usually limited to a few specialised fields. If AI could learn scientific taste, it could reduce reliance on human experts and accelerate scientific discovery. Whether AI can learn this ability remains an open question. We introduce Reinforcement Learning from Community Feedback (RLCF) to learn judgement and ideation. Scientific Judge learns from community feedback, such as citations. Scientific Thinker learns to propose research ideas with high potential impact. Experiments show that Scientific Judge outperforms strong LLM baselines and that learned judgement generalises to future-year papers, other community metrics, and unseen fields. Furthermore, Scientific Thinker proposes research ideas with higher potential impact than those proposed by baselines. These results suggest that AI can learn scientific taste, marking an important step towards AI systems that could help accelerate scientific discovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。