披露AI的说服意图能显著降低其影响力,比仅说明AI身份更有效。
Toward Meaningful Transparency for AI Chatbots: Disclosing Persuasive Intent Reduces Persuasion

- 通过实验对比三种披露方式:无披露、仅说明是AI、再加说明说服意图。
- 仅披露AI身份时影响仍达13.1分(原12.6分),而加了意图披露后降至6.3分。
- 揭示意图让用户觉得手段不正当,支持更强监管,适合政策制定者参考。
AI生成内容在公共传播中的作用日益增长,监管机构要求明确披露内容来源与AI参与情况。但此类披露的实际效果尚不明确。我们通过一项预注册实验,测试两种披露方式对AI聊天机器人说服力的影响。1500名英国成年人参与了关于60个政策议题的简短对话,所有参与者面对的聊天机器人完全相同。随机分配三种披露条件:无披露(对照组)、明显提示正在与AI交互(T1)、以及在此基础上补充说明聊天机器人具有说服意图及指令(T2)。对照组中,聊天机器人使态度改变12.6分(满分100分)。仅披露AI身份时,态度变化为13.1分,几乎无差异;而加入说服意图披露后,效果减半至6.3分。同时,该披露使参与者认为宣传手段更不可接受,并支持更严厉惩罚。对于直接聊天机器人交互,仅透明化AI身份无法显著削弱其影响力。当前规则侧重系统身份,我们的结果表明,针对说服性AI的监管必须同时关注其行为目的。
原文摘要 · Abstract (English)
The growing role of AI-generated content and AI-enabled systems in public communication has led regulators to demand clear disclosure of content provenance and AI involvement. But the effects of such disclosures remain uncertain. We test two disclosure approaches in their impact on an AI chatbot's persuasive appeal. In a preregistered experiment, 1,500 UK adults held a short conversation with a persuasive chatbot about one of 60 policy issues. The chatbot was identical for everyone. We randomized the disclosure that people received: nothing (control), a prominent disclosure that they were interacting with an AI (T1), or that disclosure plus the chatbot's persuasive intent and instructions (T2). The chatbot shifted attitudes by 12.6 points on a 100-point scale in the control group. The AI-identity disclosure was practically equivalent to no disclosure, with a 13.1-point shift, whereas the additional intent disclosure cut the persuasive effect roughly in half to 6.3 points. It also made participants view the campaign's methods as less acceptable and support stronger penalties against it. For direct chatbot interactions, transparency about AI identity alone does not meaningfully impact its influence. While current rules emphasize what a system is, our results show why the regulation of persuasive AI must also address what the system is trying to do.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。