arXiv:2606.06252cs.AI2026-06

让隐式推理过程可回溯,提升模型答对率。

Closing the Loop on Latent Reasoning via Test-Time Reconstruction

论文配图:Closing the Loop on Latent Reasoning via Test-Time Reconstruction
图 1 · 摘自论文原文
  • 用查询自重构机制,在测试时闭环验证隐状态
  • 在Qwen3-8B上使AIME2024准确率提升16.6点至73.3%
  • 适合追求高精度推理的开发者和研究者

近期工作将中间推理从自然语言表示转为隐空间或缓存级表示,以降低令牌开销并避免离散通信瓶颈。然而,这一转变也使中间状态不可见,难以判断隐状态是否仍保留原始查询的约束。因此,隐式推理通常处于开环状态,即隐状态生成后直接使用,缺乏输入锚定的可信度检验。本文提出ReLAT(测试时重构引导的隐式推理),一种自监督的测试时训练方法,利用查询自身作为参考来闭合该循环。核心观察是:若隐状态真实代表查询,则应能从中恢复原查询;否则说明任务相关的信息已丢失。ReLAT通过构建可微分的‘问题→隐思考→问题’循环,并在生成答案前优化查询重建损失,使模糊的隐式计算锚定在它应代表的问题规范上。在Qwen系列的数学推理、知识问答和代码生成基准上,ReLAT持续优于单模型推理、基于文本协作、开环隐式协作及其它测试时训练目标。在Qwen3-8B上,其将AIME 2024准确率从56.7%提升至73.3%,较最强开环隐式基线高出16.6个百分点。

原文摘要 · Abstract (English)

Recent work moves intermediate reasoning from natural-language traces into latent or cache-level representations to reduce token overhead and avoid a discrete communication bottleneck. However, this shift also removes a key advantage of textual reasoning: intermediate states are no longer inspectable, making it difficult to determine whether a latent state still preserves the constraints of the original query. As a result, latent reasoning typically operates in an open loop, where a latent state is produced and consumed without an input-anchored fidelity check. We propose ReLAT (Reconstruction-Guided Latent Reasoning At Test Time), a self-supervised test-time training method that closes this loop using the query itself as the reference. Our key observation is that if a latent state faithfully represents a query, the query should be recoverable from it; if the query cannot be recovered, the latent state has lost task-relevant information. ReLAT operationalizes this principle by constructing a differentiable Question -> Latent Thought -> Question cycle and optimizing query reconstruction loss through the latent thought before answer generation. This anchors opaque latent computation to the problem specification it is supposed to represent. Across mathematical reasoning, knowledge QA, and code generation benchmarks on the Qwen family, ReLAT consistently improves over single-model inference, text-based collaboration, open-loop latent collaboration, and alternative test-time training objectives. On Qwen3-8B, ReLAT raises AIME 2024 accuracy from 56.7% to 73.3%, a 16.6-point gain over the strongest open-loop latent baseline.

隐式推理测试时训练自监督Qwen

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。