arXiv:2607.07669cs.CLcs.AI2026-07被引 1

让大模型真正生成方言英语,而非只会理解。

DiaLLM: An Investigation into the Robustness-Generation Gap in English Dialect Adaptation

论文配图:DiaLLM: An Investigation into the Robustness-Generation Gap in English Dialect Adaptation
图 1 · 摘自论文原文
  • 用国际英语语料库持续预训练,结合显式/隐式微调策略
  • 显式目标适配能生成可识别的方言,但最优奖励不被人类偏好
  • 揭示了模型鲁棒性与生成能力分离,需更好奖励设计

大型语言模型虽能理解方言英语,却仍主要生成标准美式英语,方言生成问题未被解决。我们提出DiaLLM,对三个开源模型家族在国际英语语料库上进行持续预训练,并结合隐式与显式后训练范式,每种搭配三种模型对齐策略,首次在澳大利亚、印度和北英英语中实现可控对比。结果表明,方言鲁棒性与生成能力相互独立:基准测试受持续预训练和监督微调影响,而对齐显著改变生成内容,但基准无法捕捉。显式变体目标适配生成的文本被可靠识别为方言且更受青睐,但最激进优化方言奖励的方法并未获人类偏好。独立语言学分析证实这一奖励-质量差距,尤其在三个模型族中的两个上表现明显。无单一对齐方法占优,缩小差距需更丰富的奖励设计和持续投入方言资源。所有代码、检查点及偏好数据集均已开源。

原文摘要 · Abstract (English)

Large language models increasingly \emph{understand} dialectal English, yet still \emph{produce} only standard, US-leaning English, leaving dialectal generation, the harder half of the problem, largely unaddressed. We introduce \textbf{DiaLLM}, which continually pretrains three open-weight language model families on the International Corpus of English and applies implicit and explicit post-training paradigms, each combined with three model alignment strategies, giving the first controlled comparison of these components across Australian, Indian, and Northern British English. Our results reveal that dialectal robustness and generation are \emph{dissociated}: benchmarks are shaped by continual pretraining and SFT, while alignment visibly reshapes generation in ways benchmarks do not capture. Explicit variety-targeted adaptation produces output reliably recognised as dialectal and preferred over broad alignment, yet the method that most aggressively optimises the dialectal reward is not preferred by human evaluators. Independent linguistic analysis corroborates this reward-quality gap, most clearly on two of the three families. No single alignment method dominates, and closing the gap will require richer reward designs and continued investment in dialectal resources. We release all code, checkpoints, and preference datasets.

方言生成模型对齐大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。