大模型通过竞争性语料频率学会不说不合语法的话。
Do Language Models Know What Not to Say? Causal Evidence for Statistical Preemption in LLMs
- 用语料竞争频率解释模型为何拒绝不合法表达。
- 模型对错误句式的意外度与人类判断高度一致(r=0.79)。
- 模型越大越敏感,且可被训练干预精准调控。
学习者如何在无负面证据情况下掌握哪些表达不可接受?构式语法提出统计预占机制:接触常见形式(如“捐赠书籍给图书馆”)会抑制结构上可能但未出现的替代形式(*“捐赠图书馆书籍”)。本研究首次在单一实验设计中,直接区分大语言模型中的统计预占与竞争假设。针对120个英语动词-构式组合(与格、使役、处所),四组实验表明:(1) 模型的意外度模式与人类接受度高度相关(r=0.79),经三个独立行为数据集验证;(2) 这一模式由竞争形式频率驱动,而非动词总体频率,通过非循环偏相关确认;(3) 预占敏感性随模型规模呈幂律增长;(4) 受控微调实验证明,操纵竞争形式频率可按预期方向改变预占行为,反向控制排除了频率敏感性的混杂影响。结果为神经语言模型通过分布竞争获得否定性语言知识提供了多路径支持,呼应构式语法核心机制。
原文摘要 · Abstract (English)
How do learners acquire knowledge of what is unacceptable without negative evidence? Construction Grammar proposes statistical preemption: exposure to a conventional form (e.g., "donated the books to the library") preempts structurally possible but unattested alternatives ("*donated the library the books"). We present a computational study that, for the first time, directly dissociates statistical preemption from the competing entrenchment hypothesis in large language models within a single converging design. Across four experiments spanning 120 English verb-construction pairings (dative, causative, locative), we show that (1) LLM surprisal patterns correlate strongly with human acceptability judgments ($r = 0.79$), validated against three independent behavioral datasets; (2) these patterns are driven by competing-form frequency rather than overall verb frequency, confirmed by non-circular partial correlations; (3) preemption sensitivity scales as a power law with model size; and (4) a controlled fine-tuning intervention causally demonstrates that manipulating competing-form frequencies shifts preemption behavior in the predicted direction, with reverse-direction controls ruling out frequency-sensitivity confounds. These results provide converging evidence that neural language models acquire negative linguistic knowledge through distributional competition, the core mechanism posited by Construction Grammar.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。