arXiv:2602.14469cs.CL2026-02被引 2

提出新方法降低推理生成中答案依赖,提升模型泛化能力

Measuring and Mitigating Post-hoc Rationalization in Reverse Chain-of-Thought Generation

  • 用结构骨架先生成抽象推理框架,再填充细节以解耦答案影响
  • 实验显示新方法在多个数据集上性能提升最高达10分,且更稳定
  • 适合关注推理可解释性与泛化能力的研究者

逆链式思维生成(RCG)从问答对中合成推理过程,但存在答案可见性导致的后验辩护问题:模型并非真正推理得出答案,而是为已有答案找理由。这造成训练与推理不一致——训练时使用带答案条件的推理轨迹,而推理时无法访问答案。本文通过词汇重叠、轨迹锚定和概率可恢复性三方面量化该偏差。发现看似有效的语义抑制虽降低词汇重叠,却加剧轨迹锚定:为避开答案,模型反而需持续追踪它,强化其影响。为此提出结构骨架引导推理(SSR),先生成抽象功能骨架,再据此生成完整推理路径。锚定分析表明,SSR有效降低了三种形式的答案依赖。在域内与域外基准测试中,其压缩版本SSR-D相比抑制基线最高提升10分,且更优保持域外性能。代码已开源。

原文摘要 · Abstract (English)

Reverse Chain-of-Thought Generation (RCG) synthesizes reasoning traces from query-answer pairs, but answer-visible generation can justify a pre-committed answer rather than derive it. This post-hoc rationalization creates a train-inference mismatch because student models are trained on answer-conditioned traces but must reason without answer access at inference time. We quantify this mismatch through lexical, trajectory, and probabilistic anchoring, measuring surface overlap, answer-conditioned generation dynamics, and answer recoverability from the trace, respectively. We find that semantic suppression, a seemingly intuitive mitigation, reduces lexical overlap but increases trajectory anchoring: avoiding the answer requires continually tracking it, thereby strengthening its influence on generation. We therefore propose Structural Skeleton-guided Reasoning (SSR), which replaces suppression with structural decoupling by first generating an abstract functional skeleton and then using it to guide the full reasoning trace. Anchoring analyses show that SSR reduces all three forms of answer dependence. Across in-domain and out-of-distribution benchmarks, its distilled variant, SSR-D, improves performance by up to 10 points over suppression baselines and better preserves out-of-distribution performance. Code is available at https://github.com/viniferagy/SSR.

推理生成链式思维模型优化可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。