指令微调模型比人类更倾向于复用对话语法结构。
Instruction-Tuned Models Locally Reuse Human Syntax More Than Humans Do
- 通过替换人类对话中的话语,测试模型对语法规则的局部复用。
- 所有模型在低频语法规则上复用率更高,且指令微调后更贴近真实对话。
- 适合研究语言模型对话行为与人类语言适应性的学者。
句法趋同(说话者向对话对象调整语法以趋同)是人类对话中广泛存在的无意识现象。大语言模型是否也表现出类似趋势,尤其是在不同句法结构上的表现仍不明确。本研究采用替换范式,让模型生成替代预先存在的1,901个匹配位置的人类对话中的发言,测量16个开源模型(Llama和Gemma,1B-70B,预训练和指令微调版)在上下文无关语法(CFG)规则上的相邻复用情况。每个模型在前一句中复用的规则均多于随机抽取的无关人类语料,且低频规则的复用差异更大。指令微调后的模型在自然输出上与真实前句的重合度高于被替换的人类回应;所有8对同架构模型在指令微调后实际前句重合度上升。然而,相较预训练版本,指令微调模型更易与无关前句重合,实际与随机之间的增量更小,且在控制目标规则集大小后,条件规则复用概率更低。探索性分析显示,各模型对前一句的词汇和语义相似性均高于对应人类回应;指令微调模型在语义相似性上普遍优于预训练版本,而词汇相似性结果则更为混杂。
原文摘要 · Abstract (English)
Syntactic convergence (the tendency of speakers to adapt in language towards the grammatical profiles of their interlocutors) is a well-documented feature of human dialogue widely considered to operate below conscious awareness. Whether large language models exhibit analogous syntactic convergence toward human users relative to human baselines and across a broad range of syntactic constructions remains an open question. Using substitution-paradigm data in which model generations replace one speaker's turns in pre-existing human dialogues, this study measures turn-adjacent reuse of context-free grammar (CFG) rules across sixteen open-weight Llama and Gemma models (1B-70B, pretrained and instruction-tuned) at 1,901 matched positions per model. Every model showed greater CFG-rule overlap with the preceding human turn than with a sampled unrelated human prime, and in every model this actual-versus-random difference was larger for lower-frequency rules. Each instruction-tuned model also showed greater natural-output overlap with the actual prime than the human response it replaced, and all eight matched architecture pairs exhibited greater actual-prime overlap after instruction tuning. However, relative to pretrained variants, instruction-tuned outputs overlapped more with unrelated primes, showed a smaller actual-versus-random increment, and had lower conditional rule-reuse odds once target rule-set size was held constant. In exploratory analyses, each model exhibited greater mean lexical and semantic similarity to the preceding turn than the matched human responses did. Instruction-tuned models additionally produced responses with greater mean semantic similarity than their pretrained counterparts in all eight architecture pairs, whereas the lexical similarity results were more heterogeneous.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。