arXiv:2504.09865cs.CYcs.AI2025-04被引 27

AI生成内容加标签,效果不如预期,仍具说服力。

Labeling Messages as AI-Generated Does Not Reduce Their Persuasive Effects

  • 用实验对比AI、人类专家和无标签信息的说服力
  • 平均影响态度变化9.74个百分点,标签无显著差异
  • 适合政策制定者与数字素养研究者参考

随着生成式人工智能(AI)以大规模和高速度传播信息,理解公众对AI生成内容的感知变得愈发重要。一种主流政策建议是明确标注AI生成内容以增强透明度并促进批判性思考,但此前研究尚未验证此类标签的实际效果。为填补这一空白,我们开展了一项针对美国多元样本的调查实验(N=1601),向参与者展示关于多项公共政策(如允许大学支付学生运动员薪酬)的AI生成信息,随机分配三类条件:(a)由专家AI模型生成,(b)由人类政策专家生成,(c)无标签。结果显示,信息普遍具有说服力,平均使参与者政策态度改变9.74个百分点。然而,尽管94.6%的参与者正确识别了作者标签,标签类型对态度变化、信息准确性判断及分享意愿均无显著影响,且该结果在不同背景人群(包括政策知识、AI使用经验、政治立场、教育水平、年龄)中均保持稳健。综合来看,虽然作者标签可提升透明度,但难以实质性削弱标签内容的说服力,提示需探索替代策略应对AI信息带来的挑战。

原文摘要 · Abstract (English)

As generative artificial intelligence (AI) enables the creation and dissemination of information at massive scale and speed, it is increasingly important to understand how people perceive AI-generated content. One prominent policy proposal requires explicitly labeling AI-generated content to increase transparency and encourage critical thinking about the information, but prior research has not yet tested the effects of such labels. To address this gap, we conducted a survey experiment (N=1601) on a diverse sample of Americans, presenting participants with an AI-generated message about several public policies (e.g., allowing colleges to pay student-athletes), randomly assigning whether participants were told the message was generated by (a) an expert AI model, (b) a human policy expert, or (c) no label. We found that messages were generally persuasive, influencing participants' views of the policies by 9.74 percentage points on average. However, while 94.6% of participants assigned to the AI and human label conditions believed the authorship labels, labels had no significant effects on participants' attitude change toward the policies, judgments of message accuracy, nor intentions to share the message with others. These patterns were robust across a variety of participant characteristics, including prior knowledge of the policy, prior experience with AI, political party, education level, or age. Taken together, these results imply that, while authorship labels would likely enhance transparency, they are unlikely to substantially affect the persuasiveness of the labeled content, highlighting the need for alternative strategies to address challenges posed by AI-generated information.

AI生成说服力标签有效性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。