arXiv:2504.10191cs.CLcs.AI2025-04ACL被引 19

发现大模型内藏本地文化知识,可被显式激活并控制输出风格。

Localized Cultural Knowledge is Conserved and Controllable in Large Language Models

  • 通过显式提示文化背景,提升多语言生成的文化契合度。
  • 发现跨非英语语言共享的文化定制向量,减少刻板印象。
  • 适合做跨文化翻译与本地化内容生成,提升模型实用性。

正如人类在说外语时会受母语影响,大语言模型在生成非英语内容时也常表现出以英语为中心的倾向。然而我们发现,本地文化信息仍存在于模型中,并可通过显式提示激活以实现文化定制。实验表明,在提示中加入文化背景能显著提升模型生成文化适配内容的能力,这种差异称为‘显式-隐式定位差距’,说明文化知识虽存在但不自然浮现。尽管显式提示有效,但生成结果多样性下降且易陷入刻板印象。我们进一步识别出一个在所有探索的非英语语言中均存在的显式文化定制向量,该向量可将模型从合成的英语文化世界模型转向特定非英语文化世界。经引导的响应保留了隐式提示的多样性,大幅降低刻板印象,显著增强定制潜力。本文讨论了显式文化定制对理解模型中多元文化世界模型存续性及其可控应用的意义,为翻译、文化定制及通过软控制使显式变隐式的扩展功能提供可能。

原文摘要 · Abstract (English)

Just as humans display language patterns influenced by their native tongue when speaking new languages, LLMs often default to English-centric responses even when generating in other languages. Nevertheless, we observe that local cultural information persists within the models and can be readily activated for cultural customization. We first demonstrate that explicitly providing cultural context in prompts significantly improves the models' ability to generate culturally localized responses. We term the disparity in model performance with versus without explicit cultural context the explicit-implicit localization gap, indicating that while cultural knowledge exists within LLMs, it may not naturally surface in multilingual interactions if cultural context is not explicitly provided. Despite the explicit prompting benefit, however, the answers reduce in diversity and tend toward stereotypes. Second, we identify an explicit cultural customization vector, conserved across all non-English languages we explore, which enables LLMs to be steered from the synthetic English cultural world-model toward each non-English cultural world. Steered responses retain the diversity of implicit prompting and reduce stereotypes to dramatically improve the potential for customization. We discuss the implications of explicit cultural customization for understanding the conservation of alternative cultural world models within LLMs, and their controllable utility for translation, cultural customization, and the possibility of making the explicit implicit through soft control for expanded LLM function and appeal.

文化定制多语言模型控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。