arXiv:2605.21227cs.CL2026-05中稿 · Neollm colocated w…

测试大模型对卢森堡语借词的识别能力,发现加结构化知识可显著提升准确率。

Do LLMs Know What Luxembourgish Borrows? Probing Lexical Neology in Low-Resource Multilingual Models

论文配图:Do LLMs Know What Luxembourgish Borrows? Probing Lexical Neology in Low-Resource Multilingual Models
图 1 · 摘自论文原文
  • 构建语言知识图谱注入提示,增强模型对借词的判断能力。
  • 借词分类准确率从25%~35%提升至71%~81%。
  • 适合低资源多语种语言研究与大模型评估应用者阅读。

大型语言模型(LLMs)在小语种写作辅助中日益普及,但其是否遵循社区对词汇借用与新词创制的规范尚不明确。本文提出LexNeo-Bench,一个基于LuxBorrow大规模卢森堡语新闻语料库构建的3,050个实例的词级基准,目标词被标注为本土词或法、德、英语借词。通过该基准,在34种提示设置下对三款多语LLM进行两项任务测试:借词类型分类与二元新词代理(借词对本土词)。无外部上下文时,模型借词分类表现仅略高于随机水平;为此构建包含源语言、形态模式与词形类比的语言知识图谱,并将实例级子图注入提示。知识图谱提示使借词分类准确率从25%–35%提升至71%–81%,大幅缩小大小模型差距,而新词检测仍困难且对少样本设计敏感。结果表明,词典感知提示对低资源接触语言的借词判断具有显著益处,且词汇资源可作为结构化上下文用于LLM评估。本研究属ENEOLI COST行动范畴,聚焦多语卢森堡语中的借词作为词汇创新形式。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly used for writing assistance in small contact languages, yet it is unclear whether they respect community norms around lexical borrowing and neology. We introduce LexNeo-Bench, a 3{,}050-instance token-level benchmark derived from LuxBorrow, a large-scale Luxembourgish news corpus, where target tokens are labelled as native or as French, German, or English borrowings. Using this benchmark, we probe three multilingual LLMs across 34 prompt settings on two tasks: borrowing type classification and a binary lexical-innovation proxy (borrowing versus native). Without external context, models perform only slightly above chance on borrowing classification, so we construct a linguistic knowledge graph that encodes donor language, morphological patterns, and lexical analogues, and inject instance-specific subgraphs into the prompt. Knowledge-graph prompts raise borrowing classification accuracy from 25 -- 35\% up to 71 -- 81\% and largely close the gap between small and large models, while leaving neology detection difficult and sensitive to few-shot design. Our results show that lexicon-aware prompting is highly beneficial for robust borrowing judgments in low-resource contact languages and that lexical resources can serve as structured context for LLM evaluation. This study was carried out within the ENEOLI COST Action and examines borrowing as a form of lexical innovation in multilingual Luxembourgish data.

大模型评估低资源语言借词识别知识图谱

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。