arXiv:2409.00135cs.CLcs.AI2024-09EMNLP被引 92

首个专为材料科学设计的LLM代理系统,解决知识过时与推理不准问题。

HoneyComb: A Flexible LLM-Based Agent System for Materials Science

  • 构建材料科学专属知识库与工具枢纽,提升专业推理能力。
  • 在多个任务上显著优于基线模型,准确率明显提升。
  • 框架可扩展至其他科学领域,适合科研自动化需求者。

专用大语言模型(LLMs)在解决材料科学复杂任务方面展现出潜力,但通常难以应对材料计算任务的独特挑战,且过度依赖过时的隐含知识,导致错误和幻觉。为此,我们提出HoneyComb,首个专为材料科学设计的基于LLM的代理系统。HoneyComb利用新型高质量材料科学知识库(MatSciKB)和复杂的工具枢纽(ToolHub),增强其针对材料科学的推理与计算能力。MatSciKB基于可靠文献构建,结构清晰;ToolHub采用归纳式工具构建方法,生成、分解并优化材料科学相关API工具。此外,HoneyComb配备检索模块,可自适应选择合适知识源或工具,确保任务准确性与相关性。实验结果表明,HoneyComb在各类材料科学任务中显著优于基线模型,有效弥合当前LLM能力与该领域专业化需求之间的差距。该灵活框架还可轻松拓展至其他科学领域,具有广泛适用前景。

原文摘要 · Abstract (English)

The emergence of specialized large language models (LLMs) has shown promise in addressing complex tasks for materials science. Many LLMs, however, often struggle with distinct complexities of material science tasks, such as materials science computational tasks, and often rely heavily on outdated implicit knowledge, leading to inaccuracies and hallucinations. To address these challenges, we introduce HoneyComb, the first LLM-based agent system specifically designed for materials science. HoneyComb leverages a novel, high-quality materials science knowledge base (MatSciKB) and a sophisticated tool hub (ToolHub) to enhance its reasoning and computational capabilities tailored to materials science. MatSciKB is a curated, structured knowledge collection based on reliable literature, while ToolHub employs an Inductive Tool Construction method to generate, decompose, and refine API tools for materials science. Additionally, HoneyComb leverages a retriever module that adaptively selects the appropriate knowledge source or tools for specific tasks, thereby ensuring accuracy and relevance. Our results demonstrate that HoneyComb significantly outperforms baseline models across various tasks in materials science, effectively bridging the gap between current LLM capabilities and the specialized needs of this domain. Furthermore, our adaptable framework can be easily extended to other scientific domains, highlighting its potential for broad applicability in advancing scientific research and applications.

材料科学LLM代理知识库工具集成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。