用表格结构提升对话系统在杂乱数据中的知识检索效果。
Structure-Aware RAG: Structured Retrieval Augmented Generation from Noisy Data for Conversational Agents

- 以表格为中间结构化表示,过滤噪声并保持关键信息
- 在两个真实噪声数据集上显著优于现有RAG基线
- 适合需要可靠外部知识的对话系统开发
大语言模型广泛应用于对话场景,但其依赖参数化知识,在需动态或领域特定信息时可靠性不足。检索增强生成(RAG)通过引入外部知识缓解此问题,但现有文本和图结构RAG方法常受噪声或无关上下文干扰。本文提出结构感知检索增强生成(SA-RAG),利用表格作为中间结构化表示,提供紧凑且可控的接口,在降低噪声的同时保留核心信息。我们设计了一种质量感知的表格元数据生成框架,建模元数据归一化与有效性,提升元数据质量与下游性能。同时探索无训练与有训练两种表格生成方法,结合生成验证与直接偏好优化,进一步提升表格质量并保持语义与结构一致性。在两个真实世界噪声数据集上的实验表明,SA-RAG显著优于现有RAG基线。代码已公开于公共仓库。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have been widely adopted in conversational applications. However, their reliance on parametric knowledge limits reliability in real-world scenarios that require dynamic or domain-specific information. Retrieval-Augmented Generation (RAG) addresses this limitation by incorporating external knowledge during generation, but existing text-based and graph-based RAG methods often struggle with noisy or irrelevant contexts. In this work, we propose Structure-aware Retrieval Augmented Generation (SA-RAG), which uses tables as an intermediate structured representation to provide a compact and controllable interface that reduces noise while preserving essential information. We introduce a quality-aware table metadata generation framework that models metadata normalization and effectiveness, improving metadata quality and downstream performance. Furthermore, we explore both training-free and training-based table generation methods. Generation validation and direct preference optimization further improve table quality while maintaining semantic and structural consistency. Experiments on two noisy real-world datasets show that SA-RAG significantly outperforms existing RAG baselines. Our code is publicly available at a public repository.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。