arXiv:2502.14767cs.CLcs.AI2025-02ACL被引 10

用多角色辩论树分析论文创新点,帮研究者高效对比跨领域文献。

Tree-of-Debate: Multi-Persona Debate Trees Elicit Critical Thinking for Scientific Comparative Analysis

  • 将论文转为LLM角色,构建动态辩论树进行批判性分析。
  • 专家评估显示能有效识别和对比不同论文的独立创新点。
  • 适合需要跨领域文献综述的研究人员使用。

随着现代技术推动科研爆发式增长,科学发现日益分散于各领域之间,导致难以评估相关工作在意义、新颖性、增量贡献及等效思想方面的差异,尤其跨研究社区时更为困难。大型语言模型(LLMs)近期展现出强大的定量与定性推理能力,多代理辩论也证明在处理复杂推理任务中可通过探索多元视角与推理路径实现突破。受此启发,我们提出树状辩论(Tree-of-Debate, ToD)框架,将科学论文转化为由LLM扮演的角色,围绕其各自新颖性展开辩论。为强调结构化、批判性推理而非仅关注结论,ToD动态构建辩论树,实现对学术论文中独立新颖性论点的细粒度分析。在多个领域科学文献上的实验表明,经专家研究人员评估,ToD生成了具有信息量的论证,能有效对比论文,并支持研究者开展文献综述。

原文摘要 · Abstract (English)

With the exponential growth of research facilitated by modern technology and improved accessibility, scientific discoveries have become increasingly fragmented within and across fields. This makes it challenging to assess the significance, novelty, incremental findings, and equivalent ideas between related works, particularly those from different research communities. Large language models (LLMs) have recently demonstrated strong quantitative and qualitative reasoning abilities, and multi-agent LLM debates have shown promise in handling complex reasoning tasks by exploring diverse perspectives and reasoning paths. Inspired by this, we introduce Tree-of-Debate (ToD), a framework which converts scientific papers into LLM personas that debate their respective novelties. To emphasize structured, critical reasoning rather than focusing solely on outcomes, ToD dynamically constructs a debate tree, enabling fine-grained analysis of independent novelty arguments within scholarly articles. Through experiments on scientific literature across various domains, evaluated by expert researchers, we demonstrate that ToD generates informative arguments, effectively contrasts papers, and supports researchers in their literature review.

科学推理多代理辩论文献分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。