用轻量提示路由让大模型自动适配不同文化，提升交互敏感度。
Whispers of Many Shores: Cultural Alignment through Collaborative Cultural Expertise
- 通过可学习的提示向量动态分配文化专家配置，无需修改主模型参数。
- 在文化对齐评分上从0.208提升至0.820，显著增强跨文化适应能力。
- 适合需要多文化场景部署的大模型应用，如跨国客服与内容生成。
将大语言模型（LLMs）融入全球应用需有效实现文化对齐以保障有意义且具文化敏感性的互动。当前的LLMs常缺乏对多元文化背景的细致理解，而传统适配方法通常需昂贵的全量微调。为此，我们提出一种新型软提示微调框架，实现高效、模块化的文化对齐。该方法利用向量化提示调优，动态将查询路由至一组由软提示嵌入优化生成的文化专精‘专家’模型配置，不改变基础模型参数。大量实验表明，该框架显著提升文化敏感性与适应性，使对齐得分从0.208提升至0.820，为文化感知型LLM部署提供稳健方案。本研究为后续探索更广泛的文化覆盖与动态专家适配铺平道路，对实现全球互联世界中具备深层语境理解的自主AI至关重要。
原文摘要 · Abstract (English)
The integration of large language models (LLMs) into global applications necessitates effective cultural alignment for meaningful and culturally-sensitive interactions. Current LLMs often lack the nuanced understanding required for diverse cultural contexts, and adapting them typically involves costly full fine-tuning. To address this, we introduce a novel soft prompt fine-tuning framework that enables efficient and modular cultural alignment. Our method utilizes vectorized prompt tuning to dynamically route queries to a committee of culturally specialized 'expert' LLM configurations, created by optimizing soft prompt embeddings without altering the base model's parameters. Extensive experiments demonstrate that our framework significantly enhances cultural sensitivity and adaptability, improving alignment scores from 0.208 to 0.820, offering a robust solution for culturally-aware LLM deployment. This research paves the way for subsequent investigations into enhanced cultural coverage and dynamic expert adaptation, crucial for realizing autonomous AI with deeply nuanced understanding in a globally interconnected world.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。