用不同语言思考,能让大模型输出更丰富多样。
Language of Thought Shapes Output Diversity in Large Language Models
- 让模型用多语言进行内部思考,而非仅用英语
- 非英语思考语言越远离英语,输出多样性提升越明显
- 多语言混合思考可进一步扩大多样性上限,适合文化多元场景
输出多样性对大语言模型至关重要,它支撑着观点多元与创造性。本文揭示:控制模型内部思考所用的语言——即思维语言(Language of Thought),可成为一种新颖且结构性的多样性来源。初步研究发现,不同思维语言在模型的思维空间中占据不同区域。基于此,我们考察了两种重复采样策略在多语言思考下的表现:单语言采样与多语言混合采样,并评估了无论思考语言为何,输出统一为英文时的多样性。大量实验表明,将思维语言从英语切换至非英语语言,能持续提升输出多样性,且存在清晰正相关关系:思维空间中距离英语越远的语言,增益越大。进一步发现,跨多种思考语言聚合样本可产生组合效应,通过引入语言异质性扩大模型的多样性上限。最终,这些发现被验证于多元对齐场景中,显著提升了模型输出的文化知识覆盖与价值取向多样性。代码已公开于 https://github.com/iNLP-Lab/Multilingual-LoT-Diversity。
原文摘要 · Abstract (English)
Output diversity is crucial for Large Language Models as it underpins pluralism and creativity. In this work, we reveal that controlling the language used during model thinking-the language of thought-provides a novel and structural source of output diversity. Our preliminary study shows that different thinking languages occupy distinct regions in a model's thinking space. Based on this observation, we study two repeated sampling strategies under multilingual thinking-Single-Language Sampling and Mixed-Language Sampling-and conduct diversity evaluation on outputs that are controlled to be in English, regardless of the thinking language used. Across extensive experiments, we demonstrate that switching the thinking language from English to non-English languages consistently increases output diversity, with a clear and consistent positive correlation such that languages farther from English in the thinking space yield larger gains. We further show that aggregating samples across multiple thinking languages yields additional improvements through compositional effects, and that scaling sampling with linguistic heterogeneity expands the model's diversity ceiling. Finally, we show that these findings translate into practical benefits in pluralistic alignment scenarios, leading to broader coverage of cultural knowledge and value orientations in LLM outputs. Our code is publicly available at https://github.com/iNLP-Lab/Multilingual-LoT-Diversity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。