AI标签能降低误信假图像，但可能引发新认知偏差。
"That's another doom I haven't thought about": A User Study on AI Labels as a Safeguard Against Image-Based Misinformation
- 通过用户调研测试标签对识别AI生成图像的影响
- 标签减少对假图像的相信，但导致对真人图更易上当
- 适合关注AI内容治理与认知安全的研究者
随着生成式AI加剧虚假现实信息的传播，立法者已要求标注生成内容。但标签是否真能降低用户受骗风险尚不明确。本研究通过五组焦点小组了解用户对标签的期待：尽管担忧实施难度，多数人认为标签有助于识别AI图像、防范欺骗。随后，我们对1354名参与者开展调查，发现标签虽降低了人们对含AI图像的虚假主张的信念，但也引发过度依赖：用户更易受真人制作图像中的虚假信息影响，且对带有标签的AI生成真实图像反而产生怀疑。
原文摘要 · Abstract (English)
As generative AI is increasingly contributing to the spread of deceptively realistic misinformation, lawmakers have introduced regulations requiring the disclosure of AI-generated content. However, it is unclear if labels reduce the risk of users falling for AI-generated misinformation. To address this research gap, we study the effect of labels on users' perception and the implications of mislabeling, focusing on AI-generated images. We first explored users' opinions and expectations of labels using five focus groups. Although participants were wary of practical implementations, they considered labeling helpful in identifying AI-generated images and avoiding deception. Second, we conducted a survey with 1354 participants to assess how labels affect users' ability to recognize misinformation. While labels reduced participants' belief in false claims supported by AI-generated images, we found evidence of overreliance, leading to unintended side effects: Participants were more susceptible to false claims accompanied by human-made images, and were more hesitant to believe true claims illustrated with labeled AI-generated images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。