arXiv:2501.15678cs.CYcs.AI2025-01被引 3

人们误以为他人消息很真诚,即便对方可能用了AI写作。

Blissful (A)Ignorance: People form overly positive impressions of others based on their written messages, despite wide-scale adoption of Generative AI

  • 用大规模实验测试不同情境下使用AI写消息对他人印象的影响。
  • 即使不确定是否用AI,接收者仍形成与真人写作无差别的积极印象。
  • 46%受访者近两周内用过AI写消息,却普遍不怀疑他人使用。

随着生成式AI(GenAI)在人际交流中的普及,理解其对社会认知的影响至关重要。根据信号理论,GenAI可能削弱书面信息的可信度,因其降低了写作成本并难以验证内容真实性。我们通过一项预注册的大规模在线实验(N = 647;Prolific),在多种沟通场景(个人与职业、熟人与陌生人)中探讨发送方使用GenAI如何影响接收方的印象,无论该使用行为是否被明确告知。结果表明:当明确告知消息由AI生成时,接收者对其印象显著降低;但在未明确提示的情况下,接收者并未表现出任何怀疑,且形成的印象几乎与纯人类写作无异。甚至当提示存在潜在但不确定的GenAI使用时,接收者反而形成更为积极的印象。值得注意的是,46%的样本在过去两周内曾使用此类工具撰写消息。研究揭示:尽管公开披露会显著影响判断,但在更真实的沟通环境中,这一信息往往不可得,导致接收者对他人可能使用GenAI处于‘幸福无知’状态。

原文摘要 · Abstract (English)

As the use of Generative AI (GenAI) tools becomes more prevalent in interpersonal communication, understanding their impact on social perceptions is crucial. According to signaling theory, GenAI may undermine the credibility of social signals conveyed in writing, since it reduces the cost of writing and makes it hard to verify the authenticity of messages. Using a pre-registered large-scale online experiment (N = 647; Prolific), featuring scenarios in a range of communication contexts (personal vs. professional; close others vs. strangers), we explored how senders' use of GenAI influenced recipients' impressions of senders, both when GenAI use was known or uncertain. Consistent with past work, we found strong negative effects on social impressions when disclosing that a message was AI-generated, compared to when the same message was human-written. However, under the more realistic condition when potential GenAI use was not explicitly highlighted, recipients did not exhibit any skepticism towards senders, and these "uninformed" impressions were virtually indistinguishable from those of fully human-written messages. Even when we highlighted the potential (but uncertain) use of GenAI, recipients formed overly positive impressions. These results are especially striking given that 46% of our sample admitted having used such tools for writing messages, just within the past two weeks. Our findings put past work in a new light: While social judgments can be substantially affected when GenAI use is explicitly disclosed, this information may not be readily available in more realistic communication settings, making recipients blissfully ignorant about others' potential use of GenAI.

生成式AI社会认知心理偏差人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。