arXiv:2608.18361cs.CL2026-08

用诗歌微调大模型,能提升隐喻理解能力

Figurative and Cultural Knowledge in LLMs: Investigating Cross-Domain Transfer through Fine-Tuning

论文配图:Figurative and Cultural Knowledge in LLMs: Investigating Cross-Domain Transfer through Fine-Tuning
图 1 · 摘自论文原文
  • 在诗歌数据上微调,提升隐喻理解准确率
  • 诗歌微调使隐喻理解提升2.33%,且非语言适应所致
  • 多语言模型比阿拉伯语专用模型更易吸收文化知识

隐喻语言深深植根于文化;流利使用不仅需要语言能力,还需文化沉浸。我们探究大模型能否学习这种关联:在文化数据上微调是否能提升隐喻理解能力,反之亦然?研究覆盖四个模型(ALLaM-7B、Fanar-1-9B、Qwen3-8B、Llama-3.1-8B)和六个阿拉伯语数据集,涵盖文化常识、谚语与诗歌,覆盖多种方言和地区。在诗歌数据上微调可使习语理解准确率提升2.33%(p<0.05),该效果无法由阿拉伯语MMLU对照实验再现,表明其源于隐喻内容而非语言适应,说明模型具备跨隐喻类型理解非字面意义的能力。反观文化微调,则降低阿拉伯语专用模型的谚语理解准确率。两者间迁移效果与噪声无异,阿拉伯语模型微调后常出现性能下降,暗示其相关知识已饱和;而多语言模型仍有更大适应空间。错误分析显示,微调强化了体验式文化知识,但削弱了基于历史的事实性知识。研究结果表明,尽管文化与隐喻在概念上紧密关联,但仅靠微调难以有效捕捉其深层联系。

原文摘要 · Abstract (English)

Figurative language is deeply culturally embedded; fluent use requires not just linguistic competence but cultural immersion. We ask whether LLMs can learn this link: does fine-tuning on cultural data improve figurative language understanding, and vice versa? We conduct a systematic study across four models (ALLaM-7B, Fanar-1-9B, Qwen3-8B, Llama-3.1-8B) and six Arabic datasets spanning cultural commonsense, proverbs, and poetry across diverse dialects and regions. Fine-tuning on poetry improves idiom comprehension (+2.33%, p<0.05), a gain our ArabicMMLU control does not reproduce, indicating that it stems from figurative content rather than Arabic language adaptation and pointing to a sensitivity to non-literal meaning that transfers across figurative types. Cultural fine-tuning, by contrast, lowers proverb-interpretation accuracy in both Arabic-centric models. Transfer between the two domains is otherwise indistinguishable from noise, with Arabic models frequently regressing after fine-tuning, suggesting prior saturation of relevant knowledge, while multilingual models show greater adaptation headroom. Error analysis further reveals that fine-tuning reinforces experiential cultural knowledge while destabilizing historically grounded factual knowledge. Our findings suggest that the relationship between culture and figurative language, though conceptually natural, is not straightforwardly captured through fine-tuning alone.

大模型隐喻理解文化知识微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。