LLM翻译爱尔兰语时会编造不存在的新词，且小模型更频繁。
Synthetic Fluency: Hallucinations, Confabulations, and the Creation of Irish Words in LLM-Generated Translations
- 分类出六种虚构名词模式，分析其是否符合爱尔兰语构词规则。
- GPT-4o Mini生成虚假词汇频率远高于GPT-4o，但类型相似。
- 引发对AI如何影响小语种语言演化的思考，适合语言技术研究者。
本研究考察大型语言模型（LLM）在翻译成爱尔兰语时的幻觉现象，重点关注模型生成的虚构、不存在词汇。我们对动词和名词类幻觉进行分类，识别出六种不同的虚构名词模式，并分析这些幻觉是否符合爱尔兰语形态规则及语言倾向。结果表明，GPT-4o与GPT-4o Mini产生相似类型的幻觉，但后者生成频率显著更高。除分类外，本文还探讨这些幻觉对爱尔兰语可能产生的影响，不寻求确定答案，而是提出关于大模型日益普及下其在塑造爱尔兰语词汇和语言演变中潜在作用的反思，旨在引发对技术如何长期影响低资源、形态丰富的语言的讨论。
原文摘要 · Abstract (English)
This study examines hallucinations in Large Language Model (LLM) translations into Irish, specifically focusing on instances where the models generate novel, non-existent words. We classify these hallucinations within verb and noun categories, identifying six distinct patterns among the latter. Additionally, we analyse whether these hallucinations adhere to Irish morphological rules and what linguistic tendencies they exhibit. Our findings show that while both GPT-4.o and GPT-4.o Mini produce similar types of hallucinations, the Mini model generates them at a significantly higher frequency. Beyond classification, the discussion raises speculative questions about the implications of these hallucinations for the Irish language. Rather than seeking definitive answers, we offer food for thought regarding the increasing use of LLMs and their potential role in shaping Irish vocabulary and linguistic evolution. We aim to prompt discussion on how such technologies might influence language over time, particularly in the context of low-resource, morphologically rich languages.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。