让大模型并行读长文档,深度推理不依赖阅读顺序。
PARSER: Read in Parallel, Reason in Depth for Long-Context LLM Agents
- 并行读取+分步追问:子代理并行扫描文档,主代理多轮迭代追问
- 896K token长文本下准确率领先12.0点,推理速度提升11倍
- 适合处理长文档问答,对信息位置不敏感,适合部署在资源受限场景
传统顺序记忆代理在处理长文档时逐块阅读并维持紧凑记忆状态,导致推理深度与阅读顺序耦合,对证据位置敏感且推理延迟随文档长度线性增长。本文提出PARSER,通过解耦阅读与推理:一组轻量级子代理并行读取整篇文档的各个段落,而主代理通过多轮散射-汇聚机制进行深度推理——每轮向所有子代理广播查询,聚合返回证据,并基于已有发现生成更深入的问题。该设计将全部可学习参数集中在主代理,使用强化学习优化,子代理保持冻结的现成模型。在7K至896K token的多跳问答任务中,4B规模的PARSER平均优于最强序列基线5.7点,896K token时领先12.0点;扩展至9B模型后,超越DeepSeek-V4-Pro 6.3点。控制实验表明,PARSER对证据位置、顺序和距离的扰动具有鲁棒性,而序列方法则出现大幅性能波动,同时推理延迟最高降低11倍。
原文摘要 · Abstract (English)
Sequential memory agents process long documents by reading chunks one after another while maintaining a compact memory state, coupling document traversal to reasoning depth. This coupling introduces sensitivity to evidence placement and ties inference latency linearly to document length. We introduce PARSER, which decouples reading from reasoning. A bank of lightweight subagents each bound to a single chunk read the entire document in parallel, while a lead agent reasons in depth through iterative scatter--gather rounds: at each round it broadcasts a query to all subagents, aggregates the returned evidence, and formulates a deeper follow-up query conditioned on what has been found so far. This decoupled design concentrates all learnable behavior in the lead agent, which is optimized with reinforcement learning, while the subagents remain frozen off-the-shelf models. On multi-hop QA with contexts ranging from 7K to 896K tokens, PARSER with a 4B backbone outperforms the strongest sequential memory baseline by 5.7 points on average and by 12.0 points at 896K tokens. Scaling to a 9B backbone, PARSER surpasses DeepSeek-V4-Pro by 6.3 points. Controlled experiments confirm that PARSER is robust to perturbations in evidence position, order, and distance, conditions that cause large accuracy swings in sequential methods, while reducing inference latency by up to 11x.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。