面对复杂交叉的文档信息,CORG通过分组处理提升问答准确率。
CORG: Generating Answers from Complex, Interrelated Contexts
- 将多文档关系分为四类,按组独立处理以减少干扰
- 在多个基准上超越现有分组方法,接近单文处理效果
- 适合需要高精度跨文档推理的应用场景
真实语料中知识常跨文档重复出现,但因命名模糊、信息过时或错误导致上下文间存在复杂关联。以往研究显示语言模型难以应对此类复杂性,通常孤立处理单一因素。本文将这些关系归纳为四类:干扰型、模糊型、反事实型和重复型。分析表明,单一方法无法同时应对所有类型。为此,我们提出上下文组织框架CORG,将多个上下文划分为可独立处理的组,使模型能高效定位所有相关答案并实现去歧义。CORG包含图构建器、重排序器和聚合器三个核心组件。实验结果表明,CORG在性能与效率间取得良好平衡,优于现有分组方法,在多项指标上达到与更耗时的单上下文方法相当的水平。
原文摘要 · Abstract (English)
In a real-world corpus, knowledge frequently recurs across documents but often contains inconsistencies due to ambiguous naming, outdated information, or errors, leading to complex interrelationships between contexts. Previous research has shown that language models struggle with these complexities, typically focusing on single factors in isolation. We classify these relationships into four types: distracting, ambiguous, counterfactual, and duplicated. Our analysis reveals that no single approach effectively addresses all these interrelationships simultaneously. Therefore, we introduce Context Organizer (CORG), a framework that organizes multiple contexts into independently processed groups. This design allows the model to efficiently find all relevant answers while ensuring disambiguation. CORG consists of three key components: a graph constructor, a reranker, and an aggregator. Our results demonstrate that CORG balances performance and efficiency effectively, outperforming existing grouping methods and achieving comparable results to more computationally intensive, single-context approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。