arXiv:2609.06037cs.IR2026-09被引 2

用视觉分析辅助大模型提取科学文献中的专业实体,提升准确率30%。

Visual Analysis of LLM-based Entity Resolution from Scientific Papers

论文配图:Visual Analysis of LLM-based Entity Resolution from Scientific Papers
图 1 · 摘自论文原文
  • 结合大模型与可视化交互,实现人机协同实体识别。
  • 在金属有机框架材料数据集上,准确率提升约30%。
  • 适合材料科学领域专家进行文献信息提炼。

本文聚焦于从海量科学文献中提取特定领域实体的可视化分析支持,传统命名实体识别方法存在固有局限。随着GPT-4等大语言模型(LLMs)的发展,其在多类型文本理解方面的集成能力显著优于传统机器学习方法。本研究提出一种整合先进LLMs与多样化可视化设计的新型可视化分析流程,支持批量实体识别。以金属有机框架(MOFs)领域及大规模数据集CSD-MOFs为例,通过与材料科学专家合作获取高质量标注的合成段落。我们提出基于视觉分析的人机协同精炼机制,允许专家交互式地将领域洞察融入LLM推理过程,包括错误分析和检索增强生成(RAG)算法的解释。案例研究显示,该人机协作方法使单文档实体识别准确率提升约30%。

原文摘要 · Abstract (English)

This paper focuses on the visual analytics support for extracting domain-specific entity from extensive scientific literature, a task with inherent limitations using traditional named entity resolution methods. With the advent of large language models (LLMs) such as GPT-4, significant improvements over conventional machine learning approaches have been achieved due to LLM's capability on entity resolution integrate abilities such as understanding multiple types of text. This research introduces a new visual analysis pipeline that integrates these advanced LLMs with versatile visualization and interaction designs to support batch entity resolution. Specifically, we focus on a specific material science field of Metal-Organic Frameworks (MOFs) and a large data collection namely CSD-MOFs. Through collaboration with domain experts in material science, we obtain well-labeled synthesis paragraphs. We propose human-in-the-loop refinement over the entity resolution process using visual analytics techniques, which allows domain experts to interactively integrate insights into LLM intelligence, including error analysis and interpretation of the retrieval-augmented generation (RAG) algorithm. Our evaluation through the case study of example selection for RAG demonstrates that this human-machine collaborative approach improved single-document entity resolution accuracy by approximately 30%.

实体识别大模型可视化分析材料科学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。