arXiv:2606.11445cs.AI2026-06

让AI自己预测自身行为,比读它推理过程更准更快。

Forecasting Future Behavior as a Learning Task

论文配图:Forecasting Future Behavior as a Learning Task
图 1 · 摘自论文原文
  • 用单次推理轨迹训练预测模型,跳过解释步骤。
  • 预测重跑答案重复率和删减输入影响,准确率超GPT-5.4和Claude Opus-4.6。
  • 无需人工标注,推理成本极低,适合高效评估大模型行为。

信任AI系统常依赖对其工作方式的解释,以此预测其在新输入下的行为。对于大推理模型(LRMs),传统方法难以适用:单标记生成的解释难以推广到长推理轨迹,且轨迹本身作为自然语言常不忠实。本文提出新思路:将行为预测视为可学习任务,直接训练行为预测器,仅基于一次推理轨迹即可完成预测,无需解释。训练数据通过无标注查询获得,推理仅需一次前向传播。我们在两个任务上验证:模型重跑时答案重复概率,以及删减输入对输出的影响。在三个不同推理数据集上测试,结果表明训练后的预测器比GPT-5.4和Claude Opus-4.6阅读相同轨迹更准确,且推理开销极小。发现端到端微调骨干网络并从目标模型初始化是性能优异的关键。结果说明,推理轨迹中蕴含了超越朴素阅读的信息,足以支撑精准行为预测。

原文摘要 · Abstract (English)

Trust in an AI system is often anchored by explanations of how it works, which one then uses to forecast its behavior on new inputs. For large reasoning models (LRMs), this conventional route is particularly difficult to follow: explanation methods for single token generations do not naturally generalize to long trajectories, and the trajectories themselves are often not faithful when read as natural language. We propose an alternative that bypasses the explanation step: treat behavior forecasting as a learnable task and train Behavior Forecasters that operates on a single reasoning trajectory to make the same forecasts one would typically seek from an explanation. The forecaster's training data is obtained by querying the LRM with no human annotation, and its inference is done in a single forward pass. We instantiate this approach on two tasks: how likely the LRM is to repeat its answer on re-runs, and how removing parts of the input changes its answer. We evaluate this approach on both tasks across three diverse reasoning datasets and find that trained Behavior Forecasters are more accurate than GPT-5.4 and Claude Opus-4.6 reading the same trajectories as naive readers, at a small fraction of their inference cost. We find that fine-tuning the backbone end-to-end and initializing it from the target LRM are each necessary for strong performance. These results show that the reasoning trajectory carries information about the LRM's future behavior that goes beyond what naive reading conveys.

行为预测大模型推理轨迹零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。