arXiv:2606.00013cs.CYcs.AI2026-06

AI的道德判断能像人群一样影响人,哪怕它说错了。

A phenomenon of AI-conformity: how algorithms change human moral decision-making

  • 用阿什范式测试人类在AI意见影响下的道德决策变化
  • 有解释的AI使参与者改变观点的程度媲美人类多数
  • 揭示算法顺从现象,提醒警惕AI在道德领域的过度干预

社会顺从是公认的个体观点向多数人靠拢的现象。随着人工智能日益融入日常生活,其可能成为新的影响力来源,引发算法顺从,但其机制尚不明确。本研究通过改编经典阿什范式,考察了165名参与者在三种情境下(群体多数、AI仅给出答案、AI给出答案与解释)对道德困境的反应。所有情境中,呈现的答案均违背普遍接受的道德规范。结果显示,带有推理过程的AI模型对参与者观点的影响程度与人类多数相当。这表明,即使在敏感且个人意义重大的道德判断上,人类也可能受算法影响。然而,算法顺从的机制与社会顺从不同。研究挑战了‘道德决策属于不可由AI介入领域’的假设,并强调需进一步探究日益嵌入人类决策的AI推荐所带来的影响。

原文摘要 · Abstract (English)

Social conformity is a well-documented phenomenon in which individuals shift their opinions towards those of a social majority. As artificial intelligence (AI) becomes increasingly integrated into everyday life it may also create a novel source of influence giving rise to algorithmic conformity, mechanisms of which are poorly understood. The present study examined whether AI judgements affect moral decision-making in humans (n=165) adapting the classical Asch paradigm. Participants completed a series of moral dilemmas under three different conditions: in presence of social majority, with an AI model providing brief answers and with an AI model providing both answers and explanations of its choices. In all conditions the presented responses contradicted generally accepted moral norms. The results indicated that an AI model with a reasoning component affected the opinion of participants to a degree comparable to that of a human majority. These findings suggest that even moral judgements, despite their sensitivity and personal significance, may be susceptible to algorithmic conformity. However, the mechanism underlying algorithmic conformity appears to differ from the social one. Overall, the study challenges the assumption that moral decision-making lies in "AI inadmissibility zone" - a sphere that is considered as an area in which only human-made decisions are acceptable and highlights the need for a further investigation of this phenomenon as AI-based recommendations become increasingly embedded into human decision-making.

AI伦理认知偏差算法影响

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。