arXiv:2609.04024cs.AIcs.CL2026-09

重复指令可提升语言模型生成结果的稳定性,无需重训练。

Instruction Duplication as an Inference-Time Control Primitive

  • 仅在推理时复制过程指令,不改变模型或解码策略。
  • 诊断通过率从90.22%升至93.17%,失败率减少30.2%。
  • 适合需要稳定轨迹输出的下游系统,如答案修复与诊断分支保留。

程序化指令遵循是可控语言模型系统的基本需求,尤其在生成轨迹需后续检查或修复时。本文提出指令复制——一种最小化、黑箱式的推理时控制方法,仅重复程序指令,无需重训练或修改解码过程。在七种指令微调模型、300道医学多选题、八种放置条件及16,800次调度生成中,将指令从1份增至2份,确定性全8测试通过率由90.22%提升至93.17%(+2.95个百分点),消除剩余失败的30.2%。预初版TF-IDF召回率从73.44%升至74.81%(+1.38点;霍尔姆校正p<0.001),最终答案准确率维持60.21%不变。过早承诺率从1.52%增至2.30%(p_Holm=0.00536)。盲测审计获10/30方向确认、20/30感知持平,无反向结果;预设28/30确认标准未达。但在下游系统基于生成轨迹操作时,该差异具实际意义。在答案工程(AE)中,首因无编辑的SSNHL端点为25.1%;仅系统自修的再现结果为84.2%,加入尾随重复后提升至97.1%。对于传导性诊断分支保留,对应值分别为58.9%(无编辑)、78.6%(复现AE)、73.8%(AE+重复)——虽在AE内略有下降,但仍比无编辑基线高14.9点。因此,指令复制是一种低复杂度、依赖位置的控制手段,其实际价值在消费轨迹的下游系统中显现。

原文摘要 · Abstract (English)

Procedural instruction following is a basic requirement for controllable language-model systems, especially when generated trajectories are inspected or repaired downstream. We introduce instruction duplication, a minimal black-box inference-time control that repeats only the procedural instruction, without retraining or decoding changes. Across seven instruction-tuned models, 300 medical multiple-choice questions, eight placement conditions, and 16,800 scheduled generations, moving from one to two copies raises the deterministic All-8 diagnostic--responses passing all eight observable tests--from 90.22% to 93.17% (+2.95 percentage points), eliminating 30.2% of the failures remaining after one copy. Pre-provisional TF-IDF recall rises from 73.44% to 74.81% (+1.38 points; Holm-adjusted p < .001), while final-answer accuracy remains exactly 60.21%. Premature commitment increases from 1.52% to 2.30% (p_Holm = .00536). A blinded challenge audit yields 10/30 directional confirmations, 20/30 perceptual ties, and no reversals; its prespecified 28/30 confirmation criterion is not met. Yet this distinction can matter operationally when a downstream system acts on the generated trajectory. In Answer Engineering (AE), where explicit trajectory state determines local repair, the published reason-first no-editing SSNHL endpoint was 25.1%; system-only AE was later reproduced at 84.2%, and the same trailing duplicate raised it to 97.1%. For conductive diagnostic branch preservation, the corresponding values are 58.9% published without editing, 78.6% with reproduced AE, and 73.8% with AE plus duplication--a within-AE decrease, but still 14.9 points above the no-editing baseline. Instruction duplication is therefore a low-complexity, placement-sensitive control whose practical value can emerge through the downstream system that consumes the exposed trajectory.

推理控制指令复制语言模型答案工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。