让冻结的大模型自动标出关键证据,提升长文本推理准确率。
Learning Evidence Highlighting for Frozen LLMs

- 用轻量代理模型在原文加标签,不改内容也不压缩信息。
- 在推荐和问答任务中显著优于提示工程基线,提升10%以上。
- 策略可零样本迁移至不同模型,说明学到的是通用证据结构。
大语言模型虽具备良好推理能力,但在长而嘈杂的上下文中常遗漏关键证据。本文提出HiLight,一种证据强调框架,将证据选择与推理解耦,适用于冻结的LLM求解器。该框架不压缩或重写输入,而是训练一个轻量级强调代理(Emphasis Actor),在原始上下文的关键片段周围插入最小标记。随后,冻结的求解器在强化后的输入上执行下游推理。我们将强调视为弱监督决策问题,仅使用求解器的任务奖励优化代理,无需证据标注或修改求解器。在序列推荐和长上下文问答任务中,HiLight持续优于强基线的提示工程与自动化提示优化方法。所学强调策略可零样本迁移至更小或更大的未见求解器家族,包括基于API的求解器,表明代理捕捉到了真实且可复用的证据结构,而非对单一模型过拟合。
原文摘要 · Abstract (English)
Large Language Models (LLMs) can reason well, yet often miss decisive evidence when it is buried in long, noisy contexts. We introduce HiLight, an Evidence Emphasis framework that decouples evidence selection from reasoning for frozen LLM solvers. HiLight avoids compressing or rewriting the input, which can discard or distort evidence, by training a lightweight Emphasis Actor to insert minimal highlight tags around pivotal spans in the unaltered context. A frozen Solver then performs downstream reasoning on the emphasized input. We cast highlighting as a weakly supervised decision-making problem and optimize the Actor with reinforcement learning using only the Solver's task reward, requiring no evidence labels and no access to or modification of the Solver. Across sequential recommendation and long-context question answering, HiLight consistently improves performance over strong prompt-based and automated prompt-optimization baselines. The learned emphasis policy transfers zero-shot to both smaller and larger unseen Solver families, including an API-based Solver, suggesting that the Actor captures genuine, reusable evidence structure rather than overfitting to a single backbone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。