arXiv:2503.17952cs.CL2025-03被引 1

用滑动窗口保留长文档关键信息,提升知识图谱抽取效果

SLIDE: Sliding Localized Information for Document Extraction

  • 通过重叠窗口切分文档,避免长文本信息丢失
  • 英文实体提取提升24%,关系抽取提升39%;阿非利卡语提升更显著
  • 适合处理长文档、低资源语言的知识图谱构建

从长文本和低资源语言中构建精准知识图谱面临挑战,因大语言模型(LLMs)在输入过长时性能下降。这一问题在数据稀缺的低资源场景下尤为突出。现有上下文检索方法虽提升召回准确率,但面对长文档仍会截断关键信息,严重限制知识图谱构建。我们提出SLIDE(Sliding Localized Information for Document Extraction),一种通过重叠窗口生成局部上下文的分块方法,确保关键信息不丢失,显著提升超出LLM上下文长度限制的文档知识图谱抽取能力。SLIDE使GraphRAG在英文上实现实体提取提升24%、关系提取提升39%;在阿非利卡语(低资源语言)上,实体提取提升49%、关系提取提升82%。此外,其在问答任务中的全面性、多样性与赋能性指标也优于当前最优水平,验证了其在多语言与资源受限场景下的有效性。

原文摘要 · Abstract (English)

Constructing accurate knowledge graphs from long texts and low-resource languages is challenging, as large language models (LLMs) experience degraded performance with longer input chunks. This problem is amplified in low-resource settings where data scarcity hinders accurate entity and relationship extraction. Contextual retrieval methods, while improving retrieval accuracy, struggle with long documents. They truncate critical information in texts exceeding maximum context lengths of LLMs, significantly limiting knowledge graph construction. We introduce SLIDE (Sliding Localized Information for Document Extraction), a chunking method that processes long documents by generating local context through overlapping windows. SLIDE ensures that essential contextual information is retained, enhancing knowledge graph extraction from documents exceeding LLM context limits. It significantly improves GraphRAG performance, achieving a 24% increase in entity extraction and a 39% improvement in relationship extraction for English. For Afrikaans, a low-resource language, SLIDE achieves a 49% increase in entity extraction and an 82% improvement in relationship extraction. Furthermore, it improves upon state-of-the-art in question-answering metrics such as comprehensiveness, diversity and empowerment, demonstrating its effectiveness in multilingual and resource-constrained settings.

知识图谱长文本处理低资源语言文档抽取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。