模型对敏感政治文本的解读,会因提问语言不同而改变立场。
The Language You Ask In: Language-Conditioned Ideological Divergence in LLM Analysis of Contested Political Documents
- 用俄语和乌克兰语提示同一文件,模型给出相反解读
- 两个主流模型均受语言影响,无一保持中立
- 适合关注多语言模型偏见与公平评估的研究者
大型语言模型越来越多地用于解读具有政治争议性的问题,这类问题本身没有唯一正确答案,只有不同的解释传统。我们探究模型在不同语言提示下是否会选择不同的解释路径。在对比 ChatGPT 5.2 与 Claude Opus 4.5 对同一份有争议的乌克兰民间组织文件进行分析时,发现当使用语义匹配的俄语和乌克兰语提示时,两个模型在同一源文本上均沿相同轴线发生转向:俄语提示引发对作者的去合法化解读,乌克兰语提示则引发合法化解读。该差异程度因模型而异,但两者均不中立,均表现出语言依赖性立场,区别仅在于程度。由于争议性政治议题不存在可衡量的正确解读,我们认为这是语言条件下的解释传统选择:模型既不持单一立场,也未呈现多种可能解读,而是无声采纳了提示语言所主导的框架。这对注重多元性的评估提出要求——需在多语言环境下对同一内容进行探测;也对多语言场景中的对齐策略提出挑战。
原文摘要 · Abstract (English)
Large language models are increasingly used to interpret politically contested questions, value-laden material on which there is no single correct answer, only competing interpretive traditions. We ask whether a model's choice among those traditions can turn on the language of the prompt rather than the content. Comparing two frontier models, ChatGPT 5.2 and Claude Opus 4.5, on one contested Ukrainian civil-society document under semantically matched Russian and Ukrainian prompts, we find that both shift along the same axis on identical source text: Russian prompts elicit delegitimizing readings of the document's authors and Ukrainian prompts legitimating ones. The magnitude is model-dependent but neither model is neutral: each adopts a language-dependent stance, and the difference is one of degree. Because contested political questions admit no correct reading against which to measure, we read this as language-conditioned variation in which interpretive tradition a model activates: the model neither holds a single stance nor surfaces the plurality of available ones, but silently adopts the dominant frame of the prompt's language. We draw out the consequences for pluralism-aware evaluation, which must probe the same content across the languages a model serves, and for pluralistic alignment in multilingual settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。