arXiv:2502.21087cs.CLcs.AI2025-02被引 1

用规划引导的智能体,精准回答含文本与关系的半结构化数据问题

PASemiQA: Plan-Assisted Agent for Question Answering on Semi-Structured Data with Text and Relational Information

  • 先生成问答计划,再分步遍历半结构化数据
  • 在多个领域数据集上准确率显著提升
  • 适合需要融合文本与关系信息的复杂查询场景

大型语言模型在跨领域问答中表现优异,但在需要专业或实时知识的问题上常出现幻觉。为解决此问题,检索增强生成(RAG)技术被提出,通过从外部源检索信息来辅助生成。然而现有RAG方法通常仅处理单一类型外部数据,如向量化的文本数据库或知识图谱,难以应对包含文本与关系信息的半结构化数据的真实问题。为此,我们提出PASemiQA,一种联合利用半结构化数据中文本与关系信息的新方法。PASemiQA首先生成一个计划,以识别回答问题所需的相关文本和关系信息,随后使用大语言模型代理遍历半结构化数据并提取必要内容。实证结果表明,PASemiQA在多个来自不同领域的半结构化数据集上均表现出色,展现出提升半结构化数据问答系统准确性和可靠性的潜力。

原文摘要 · Abstract (English)

Large language models (LLMs) have shown impressive abilities in answering questions across various domains, but they often encounter hallucination issues on questions that require professional and up-to-date knowledge. To address this limitation, retrieval-augmented generation (RAG) techniques have been proposed, which retrieve relevant information from external sources to inform their responses. However, existing RAG methods typically focus on a single type of external data, such as vectorized text database or knowledge graphs, and cannot well handle real-world questions on semi-structured data containing both text and relational information. To bridge this gap, we introduce PASemiQA, a novel approach that jointly leverages text and relational information in semi-structured data to answer questions. PASemiQA first generates a plan to identify relevant text and relational information to answer the question in semi-structured data, and then uses an LLM agent to traverse the semi-structured data and extract necessary information. Our empirical results demonstrate the effectiveness of PASemiQA across different semi-structured datasets from various domains, showcasing its potential to improve the accuracy and reliability of question answering systems on semi-structured data.

问答系统半结构化数据LLM代理RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。