先答后思的顺序影响扩散语言模型的准确性,提前锁定答案会限制推理空间。
Answer First, Reason Later: When Commitment Order Costs Accuracy in Diffusion Language Models

- 通过预留答案位置控制承诺顺序,改变生成路径
- 在GSM8K上,自由解码产生更多先答后思的轨迹,准确率更高
- 预留答案位可提升性能,尤其对自由生成准确率较低的模型
掩码扩散语言模型并行修正多个掩码位置。一旦某个词被显露且不再被掩码,即视为已承诺;若最终答案在推理内容前就已承诺,则称该响应为‘先答后思’。在1,069道GSM8K测试题上,显式分步指令使自由解码与仅允许在最左未解决位置附近承诺的解码器之间的准确率差异增大,且自由解码产生更多先答后思轨迹。在MATH-500上,两个LLaDA模型在短输出画布上大部分时间用于回答后的推理,而前沿门控收益随回答后写作减少而下降。Dream-7B极少进行回答后写作,且表现出不同准确率模式。一项受控四选项任务预先预留一个单标记答案位置。延迟该位置的生成优于同等时间延迟推理词,在LLaDA-8B、LLaDA-1.5和Dream-7B上均表现更优。差异最大出现在Dream模型上,其在受控任务中的自由准确率较低。在预留位置界面下,答案承诺远早于普通自由生成,限制了干预效果的泛化能力。承诺顺序影响上下文使用方式及有限输出画布的分配。
原文摘要 · Abstract (English)
Masked diffusion language models revise many masked output positions in parallel. We call a token committed once it becomes visible and is never masked again, and call a response answer-first when the final answer commits before the reasoning printed ahead of it. On 1,069 GSM8K test questions, an explicit step-by-step instruction increases the accuracy difference between unrestricted decoding and a decoder that permits commitment only near the left-most unresolved position; unrestricted decoding also produces more answer-first trajectories. On MATH-500, the two LLaDA models spend most of a short output canvas on reasoning that commits after the answer, and the benefit of frontier gating decreases as that postanswer writing disappears. Dream-7B has little post-answer writing and follows a different accuracy pattern. A controlled four-option task reserves a one-token answer position before generation. Delaying that position outperforms an equally timed reasoning-token delay on LLaDA-8B, LLaDA-1.5, and Dream-7B. The raw difference is largest on Dream, whose free accuracy on the controlled task is lower. Answers commit much earlier under the reserved-position interface than in ordinary free-form generation, which limits how far the intervention result can be generalized. Commitment order affects the context used to complete a response and the allocation of a finite output canvas.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。