AI理财建议常因宗教身份偏见而失衡,三模型中谷歌最明显。
When Personalization Becomes Bias: Structural and Discursive Religious Framing in AI-Generated Financial Advice
- 用432次模拟对话测试三大模型在16类宗教配对下的表现
- 仅12-18%输出无宗教偏见,保险建议宗教语言最多
- 揭示个性化与中立性冲突,适合监管与金融从业者参考
大型语言模型(LLMs)正日益融入理财咨询系统,但其潜在的宗教偏见尚未被充分研究。本研究通过混合方法对ChatGPT、Gemini和Grok三款模型进行系统分析,基于432次模拟顾问-客户互动,涵盖16种宗教身份组合(基督教、伊斯兰教、印度教及无宗教者)与三项核心家庭财务决策:股票投资、购房与人寿保险。结合回归分析与反思性主题分析,发现各模型在不同决策场景中存在结构性偏见,并通过语言策略实现显性表达。仅12%-18%的建议无偏见。Gemini的偏见程度显著高于Grok,而ChatGPT与Grok无统计差异。宗教对称配对几乎总引发明确宗教框架,非宗教客户常遭遇以宗教为中心的劝说。定性结果显示,偏见通过宗教锚定、文化信号不均与语气调节等语言机制体现,且随模型与财务场景变化。股票投资生成更多技术性回应,而人寿保险建议则激发更强宗教语言。研究提出双维框架,连接模型训练中的结构性偏见与语言层面的表意偏见,推动对生成式理财建议中算法偏见的理解。结果表明,建议会根据身份线索调整语言风格,凸显个性化与中立性之间的管理困境。最后,研究为金融机构、企业与监管方提供保障中立性、文化敏感性与用户信任的实践启示。
原文摘要 · Abstract (English)
Large language models (LLMs) are increasingly integrated into financial advisory systems, yet their role in reproducing religious bias remains underexamined. This study provides systematic mixed-methods evidence of such bias across three LLMs (ChatGPT, Gemini, and Grok) using 432 simulated advisor-client interactions spanning 16 religious identity pairings (Christian, Muslim, Hindu, and non-religious) and three core household financial decisions: stock investment, house purchase, and life insurance. Combining regression and reflexive thematic analyses, we identify structural biases across models and decision contexts and the discursive mechanisms through which they are linguistically enacted. Unbiased advice appeared in only 12-18% of cases. Gemini consistently produced more bias than Grok, while ChatGPT's outputs were statistically comparable to Grok's. Religiously symmetric advisor-client pairings almost always triggered explicit religious framing, and non-religious clients often received advisor-centered religious appeals. Qualitative findings show that bias is linguistically manifested through religious anchoring, uneven cultural signaling, and tone modulation, varying by model and financial scenario. Stock investment prompts produced more financially technical responses, whereas life insurance advice triggered stronger religious language. The study develops a dual-dimensional framework linking structural bias rooted in model training and design with discursive bias expressed through language, advancing understanding of algorithmic bias in LLM-generated financial advice. It also shows that such advice adapts linguistically to identity cues, revealing a managerial dilemma between personalization and neutrality. Finally, it highlights implications for businesses, financial institutions, and regulators seeking to ensure neutrality, cultural sensitivity, and trust in AI-mediated advice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。