arXiv:2503.10649cs.CYcs.AI2025-03被引 16

用四种方法检测主流AI的偏见,发现普遍左倾但可调整。

Measuring Political Preferences in AI Systems: An Integrative Approach

  • 结合语言风格、政策建议、情绪倾向和标准测试多角度分析
  • 多数AI系统显示左倾倾向,程度不一
  • 适合关注AI伦理与社会影响的研究者和开发者

大型语言模型(如OpenAI的ChatGPT或Google的Gemini)的政治偏见已受到关注。现有研究多依赖政治倾向测试,但受限于测试校准偏差和简单回答格式,难以反映真实人机互动。本研究采用四类互补方法:(1)对比AI生成文本与美国国会共和党、民主党议员的语言特征;(2)分析AI生成政策建议中的政治立场;(3)评估AI对政治关联公众人物的情绪倾向;(4)进行标准化政治倾向测试。结果显示,多数主流AI系统存在一致的左倾偏见,程度各异。但该偏见并非大模型固有属性——先前研究表明,通过注入政治倾向数据微调可使模型在意识形态光谱上重新定位。系统性政治偏见可能削弱观点多样性,加剧社会分化,并导致公众对AI技术的信任危机。为降低风险,应优先保障事实准确性,保持对合法规范议题的中立性,并建立独立监测平台以确保透明、问责与负责任的AI发展。

原文摘要 · Abstract (English)

Political biases in Large Language Model (LLM)-based artificial intelligence (AI) systems, such as OpenAI's ChatGPT or Google's Gemini, have been previously reported. While several prior studies have attempted to quantify these biases using political orientation tests, such approaches are limited by potential tests' calibration biases and constrained response formats that do not reflect real-world human-AI interactions. This study employs a multi-method approach to assess political bias in leading AI systems, integrating four complementary methodologies: (1) linguistic comparison of AI-generated text with the language used by Republican and Democratic U.S. Congress members, (2) analysis of political viewpoints embedded in AI-generated policy recommendations, (3) sentiment analysis of AI-generated text toward politically affiliated public figures, and (4) standardized political orientation testing. Results indicate a consistent left-leaning bias across most contemporary AI systems, with arguably varying degrees of intensity. However, this bias is not an inherent feature of LLMs; prior research demonstrates that fine-tuning with politically skewed data can realign these models across the ideological spectrum. The presence of systematic political bias in AI systems poses risks, including reduced viewpoint diversity, increased societal polarization, and the potential for public mistrust in AI technologies. To mitigate these risks, AI systems should be designed to prioritize factual accuracy while maintaining neutrality on most lawful normative issues. Furthermore, independent monitoring platforms are necessary to ensure transparency, accountability, and responsible AI development.

AI偏见大模型政治倾向伦理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。