用技能合约分离检索与生成,提升材料文献分析的准确性与可信度。
Skill-Contracted Agents for Evidence-Aware Materials Literature Analysis

- 通过技能合约拆分检索与报告生成任务,明确分工提高效率。
- 在40个问题上显著优于基线系统,尤其在机理解释和可信边界识别上表现突出。
- 适合需要深度分析材料文献的研究人员,特别是跨论文综合判断场景。
材料科学文献分析需同时关注成分、工艺、表征与性能关系,但传统检索增强生成框架难以统一处理异构任务。本文提出AlphaAgent,一种基于技能的智能体框架,通过显式技能合约将基于检索的问答与论文级报告生成解耦。专用检索技能将用户请求转化为材料特定搜索意图,向超过30万篇来自《期刊引证报告》冶金与冶金工程类别的精选论文索引发起查询,并在初始证据不足时重写查询。独立的报告生成技能解析全文PDF,生成逐篇分析报告及跨论文总结。在40个材料科学问题的盲评中,一半需深度分析推理,AlphaAgent显著优于同模型、同索引规模、同检索量级的基线系统,尤其在机理解释与可信边界意识方面提升明显。结果表明,显式任务分离、精细化检索意图与证据感知生成可显著提升大模型在材料研究文献分析中的表现。
原文摘要 · Abstract (English)
Materials science literature analysis requires simultaneous attention to composition, processing, characterization, and property relationships, yet conventional retrieval-augmented generation pipelines struggle to reconcile heterogeneous tasks within a single retrieve-then-generate architecture. Here we present AlphaAgent, a skill-driven agent framework that decouples retrieval-based question answering from paper-level report generation through explicit skill contracts. A dedicated retrieval skill rewrites user requests into material-specific search intents, queries a curated index of more than 300,000 papers from the Journal Citation Reports Metallurgy and Metallurgical Engineering category, and reformulates queries when initial evidence is insufficient. A separate report-generation skill parses full-text PDFs to produce structured per-paper analytical reports and cross-paper summaries. In a blind evaluation on 40 materials-science questions, half of which required deep analytical reasoning, AlphaAgent substantially outperformed a baseline system matched for underlying model, document index, and retrieval scale, with the largest gains in mechanistic explanation and awareness of credibility boundaries. These results indicate that explicit task separation, refined retrieval intent, and evidence-aware generation improve large-language-model-based literature analysis for materials research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。