用多元文化视角评估并改进大模型教育应用中的偏见问题。
Toward Inclusive Educational AI: Auditing Frontier LLMs through a Multiplexity Lens
- 引入多元性框架,通过系统提示或多方代理协作减少文化偏见。
- 多代理系统使观点分布熵从3.25%提升至98%,显著增强包容性。
- 适合关注AI公平性、跨文化教育的开发者与研究者参考。
随着GPT-4和Llama 3等大语言模型(LLMs)在教育场景中日益普及,其嵌入的文化偏见、权力失衡与伦理局限引发广泛关注。尽管生成式AI旨在提升学习体验,却常反映西方、受教育、工业化、富裕、民主(WEIRD)文化范式,可能忽视全球多元视角。本文提出一种基于应用多元性(multiplexity)的评估与缓解框架。多元性源自伊斯兰及其他智慧传统,强调多元文化视角共存,支持融合经验科学与规范价值的多层次认知体系。分析发现,LLMs普遍存在文化极化现象,偏见体现在显性回应与隐性语境线索中。为此提出两种策略:上下文嵌入型多元LLM,在系统提示中直接注入多元原则,从底层影响输出;多智能体系统(MAS)实现型多元LLM,由代表不同文化视角的多个LLM代理协作生成平衡响应。结果表明,从上下文提示到多代理实施,文化包容性显著提升,观点分布得分(PDS)上升,且PDS熵从基线3.25%增至多代理系统下的98%。情感分析进一步显示跨文化积极情绪显著增强。
原文摘要 · Abstract (English)
As large language models (LLMs) like GPT-4 and Llama 3 become integral to educational contexts, concerns are mounting over the cultural biases, power imbalances, and ethical limitations embedded within these technologies. Though generative AI tools aim to enhance learning experiences, they often reflect values rooted in Western, Educated, Industrialized, Rich, and Democratic (WEIRD) cultural paradigms, potentially sidelining diverse global perspectives. This paper proposes a framework to assess and mitigate cultural bias within LLMs through the lens of applied multiplexity. Multiplexity, inspired by Senturk et al. and rooted in Islamic and other wisdom traditions, emphasizes the coexistence of diverse cultural viewpoints, supporting a multi-layered epistemology that integrates both empirical sciences and normative values. Our analysis reveals that LLMs frequently exhibit cultural polarization, with biases appearing in both overt responses and subtle contextual cues. To address inherent biases and incorporate multiplexity in LLMs, we propose two strategies: \textit{Contextually-Implemented Multiplex LLMs}, which embed multiplex principles directly into the system prompt, influencing LLM outputs at a foundational level and independent of individual prompts, and \textit{Multi-Agent System (MAS)-Implemented Multiplex LLMs}, where multiple LLM agents, each representing distinct cultural viewpoints, collaboratively generate a balanced, synthesized response. Our findings demonstrate that as mitigation strategies evolve from contextual prompting to MAS-implementation, cultural inclusivity markedly improves, evidenced by a significant rise in the Perspectives Distribution Score (PDS) and a PDS Entropy increase from 3.25\% at baseline to 98\% with the MAS-Implemented Multiplex LLMs. Sentiment analysis further shows a shift towards positive sentiment across cultures,...
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。