arXiv:2602.01840cs.CL2026-02ACL被引 11

让大模型像人一样读长文本,重点精读、次要略读,提速12倍

Read As Human: Compressing Context via Parallelizable Close Reading and Skimming

  • 分段并行处理文本,重要部分完整保留,次要部分压缩成摘要向量
  • 在16K平均长度文本上实现12倍端到端加速,且问答与摘要任务表现更优
  • 适合需要高效处理长文档的场景,如法律、科研和客服系统

大型语言模型在多种任务中表现出色,但在长上下文场景下受限于计算效率低下和信息冗余。本文提出RAM(Read As HuMan)——一种基于自适应混合阅读策略的上下文压缩框架。受人类阅读行为启发(即重点内容精读,次要内容略读),RAM将上下文分段,并并行编码输入查询。高相关性段落被完整保留(精读),低相关性段落则在查询引导下压缩为紧凑摘要向量(略读)。显式文本片段与隐式摘要向量拼接后输入解码器,兼顾性能与自然语言可解释性。为进一步优化精读与略读的决策边界,引入基于正负样本对的对比学习目标。实验表明,RAM在多个问答与摘要基准测试中优于现有基线,使用两种主干模型时,在平均长度16K、最大长度32K的长输入上实现最高达12倍的端到端加速。

原文摘要 · Abstract (English)

Large Language Models (LLMs) demonstrate exceptional capability across diverse tasks. However, their deployment in long-context scenarios is hindered by two challenges: computational inefficiency and redundant information. We propose RAM (Read As HuMan), a context compression framework that adopts an adaptive hybrid reading strategy, to address these challenges. Inspired by human reading behavior (i.e., close reading important content while skimming less relevant content), RAM partitions the context into segments and encodes them with the input query in parallel. High-relevance segments are fully retained (close reading), while low-relevance ones are query-guided compressed into compact summary vectors (skimming). Both explicit textual segments and implicit summary vectors are concatenated and fed into decoder to achieve both superior performance and natural language format interpretability. To refine the decision boundary between close reading and skimming, we further introduce a contrastive learning objective based on positive and negative query-segment pairs. Experiments demonstrate that RAM outperforms existing baselines on multiple question answering and summarization benchmarks across two backbones, while delivering up to a 12x end-to-end speedup on long inputs (average length 16K; maximum length 32K).

长文本处理上下文压缩推理加速混合阅读

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。