arXiv:2608.13959cs.CL2026-08被引 1

研究工具调用回避中约束解码的修复机制,发现其本质是修正格式而非提升质量。

Repair, Not Improvement: Decomposing Constrained Decoding in Tool-Call Abstention

  • 通过分解语法约束与停止标记,分离解码器在格式控制中的作用
  • 40亿参数模型上,回避调用使准确率下降29.5点,但修复后多数失败输出可恢复
  • 适用于关注格式正确性、工具调用可靠性的生成系统设计者

函数调用是受限生成中一个关键场景:当约束编码了正确性要求时,传统方法难以适用。本文聚焦工具调用回避,即拒绝调用任何工具的情形。以单字节相同的中英文样本为基准,在0.6B至4B规模的开源模型上进行评估。结果显示,与无约束解码相比,已有方法在六组实验中有四组对回避行为产生负向影响,最差达-29.5分;而通过枚举约束(enum)修复后,总得分由-0.5回升至+19.5。在698次被修复的回避案例中,545次原输出不可读,无一被评分者拒绝。在需要工具的任务中,回避始终表现更好,因其为预注册度量标准。该结果表明,当前方法更应关注格式修复而非性能改进。

原文摘要 · Abstract (English)

Function calling is what the recent accounting of constrained generation explicitly sets aside: it finds the decoder's contribution small for format constraints, then warns in its Section 7 against extrapolating where a constraint encodes a correctness requirement, and names function calling as one. Tool abstention is that case at its sharpest: an enum leaves the wording of an answer alone and narrows the set of answers there are, and declining to call anything is the first it drops. We measure the excluded case. Three conditions over one byte-identical prompt separate a grammar's two jobs: it fixes where generation stops as well as which tokens may be emitted. We evaluate open-weight models from 0.6B to 4B on matched English and Korean items, so the language comparison is made within item. Against an unconstrained decoder, prior work's contrast is negative on abstention in four of six cells with intervals excluding zero, worst -29.5 points, and positive with an interval excluding zero in none. The total is a sum with opposite signs: on the smallest model in Korean the stop token costs -20.0, the enum returns +19.5, and the two leave -0.5. What it recovers is form: of 698 abstentions repaired, 545 had no readable answer and 0 were judgements the scorer refused. On tool-needed items it is positive throughout; abstention leads because it is the preregistered measure, and the pooled number being kinder to the intervention makes moving to it worse rather than better. Both preregistered language claims fail.

约束解码工具调用格式修复生成评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。