让大模型通过自我提问理解长文本,提升复杂问题回答准确率。
Self-Taught Agentic Long Context Understanding
- 用自生成问题逐步澄清理解,结合上下文定位关键信息。
- 在NarrativeQA上达97.8%答案召回率,三步搜索内完成。
- 适合需要多跳推理与长文本理解的问答系统研究者。
解决长文本复杂问题仍是大语言模型的重大挑战,需有效的问题澄清与上下文检索。本文提出Agentic Long-Context Understanding(AgenticLU)框架,通过在智能体工作流中融合目标性自我澄清与上下文定位,增强模型对长序列问题的理解。核心是链式澄清(Chain-of-Clarifications, CoC),模型通过自生成澄清问题与对应上下文支撑逐步优化理解。采用树状搜索策略,每层代表一个CoC步骤,搜索深度为3、分支因子为8时,在NarrativeQA上实现97.8%的答案召回率。为降低搜索成本,利用CoC流程生成的偏好对进行两阶段微调:(1) 监督微调学习有效分解策略,(2) 直接偏好优化提升推理质量。使模型可在单次推理中高效生成澄清并检索相关上下文。在七个长文本任务上的实验表明,AgenticLU显著优于现有提示方法与专用长上下文模型,具备稳健的多跳推理能力且随上下文长度增长保持稳定性能。
原文摘要 · Abstract (English)
Answering complex, long-context questions remains a major challenge for large language models (LLMs) as it requires effective question clarifications and context retrieval. We propose Agentic Long-Context Understanding (AgenticLU), a framework designed to enhance an LLM's understanding of such queries by integrating targeted self-clarification with contextual grounding within an agentic workflow. At the core of AgenticLU is Chain-of-Clarifications (CoC), where models refine their understanding through self-generated clarification questions and corresponding contextual groundings. By scaling inference as a tree search where each node represents a CoC step, we achieve 97.8% answer recall on NarrativeQA with a search depth of up to three and a branching factor of eight. To amortize the high cost of this search process to training, we leverage the preference pairs for each step obtained by the CoC workflow and perform two-stage model finetuning: (1) supervised finetuning to learn effective decomposition strategies, and (2) direct preference optimization to enhance reasoning quality. This enables AgenticLU models to generate clarifications and retrieve relevant context effectively and efficiently in a single inference pass. Extensive experiments across seven long-context tasks demonstrate that AgenticLU significantly outperforms state-of-the-art prompting methods and specialized long-context LLMs, achieving robust multi-hop reasoning while sustaining consistent performance as context length grows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。