大模型在表达义务时比人更保守,尤其少用'应该''必须'等词。
The Deontic Gap: Large Language Models and the Modal Language of Obligation
- 分析三类语料与十一模型,发现大模型少用'must''should'等义务情态词
- 对比历史文本发现,模型使用频率接近正式书面语,低于当代非正式交流
- 在指导性场景中表现正常,但在说服性写作中明显不足,体现文体依赖
情态助动词如'must'、'should'和'have to'用于标记必要性和义务,反映说话人权威与人际立场。我们考察大语言模型(LLMs)是否再现当代人类的情态使用模式。在三个主要语料库、一个外部基准、两个受控复现及一个自然情境下的十一模型复现中,人工智能生成文本对正向义务情态词(must, should, have to, had to)的使用频率显著低于当代人类。与1920–2022年谷歌图书语料库的历史比较显示,AI的情态频率处于正式出版英语范围内,而当代人类在非正式数字语境中的使用率常超过20世纪书籍基线。短语级分解表明,人机差异集中于人际立场相关结构(should, have to, had to),而在指令与问答场景中,AI对'need to'的使用与人类相当甚至更高,但在说服性学生写作中则偏低,说明情态使用具有文体依赖性。结果表明,LLM的情态使用反映其训练所依据的正式书面资源,却低估了当代人类通过情态词表达即时人际义务的方式。
原文摘要 · Abstract (English)
Modal auxiliaries such as must, should, and have to mark necessity and obligation within the contexts of speaker authority and interpersonal stance. We examine whether large language models (LLMs) reproduce contemporary human patterns of deontic modal usage. Across three primary corpora, an external benchmark, two controlled replications, and a naturalistic eleven-model replication, AI-generated text consistently underuses positive deontic modals (must, should, have to, had to) relative to contemporary humans. Historical comparison with the Google Books Ngram corpus (1920-2022), used as a heuristic calibration against the published-prose record, shows that AI modal frequencies fall within the range of formal published English, whereas contemporary human modal rates in informal digital contexts often exceed twentieth-century book baselines. Phrase-level decomposition shows that the AI-human modal gap is concentrated in constructions central to interpersonal stance (should, have to, had to), while AI matches or exceeds humans on need to in instructional and question-answering contexts but not in persuasive student writing, indicating that the modal profile is genre-conditional. The findings suggest that LLM modal usage reflects the formal written resources on which these models were trained, while underusing the modal constructions through which contemporary human writers mark immediate, interpersonal obligation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。