人们更偏爱AI生成内容，但知道来源后偏好下降。
Users Favor LLM-Generated Content -- Until They Know It's AI
- 通过控制实验对比人类与AI回答的评价差异。
- 未透露来源时，78%用户更喜欢AI答案；披露后偏好显著降低。
- 适合关注AI认知偏见与人机协作的读者。
本文研究个体在不知情或知情情况下对人类与大型语言模型生成的回答的评价差异。通过受控实地实验，参与者被呈现一组问题及其由人类或AI生成的回答。随机分组中，一半参与者被告知回答来源，另一半则不知。结果显示，总体上参与者更偏好AI生成的回答。但当AI来源被揭示后，这一偏好显著减弱，表明评估判断受内容出处披露影响，而非仅取决于质量。这凸显了对AI生成内容的固有偏见，强调在应以质量为首要标准的情境下改善公众对AI工作的认知仍面临社会挑战。
原文摘要 · Abstract (English)
In this paper, we investigate how individuals evaluate human and large langue models generated responses to popular questions when the source of the content is either concealed or disclosed. Through a controlled field experiment, participants were presented with a set of questions, each accompanied by a response generated by either a human or an AI. In a randomized design, half of the participants were informed of the response's origin while the other half remained unaware. Our findings indicate that, overall, participants tend to prefer AI-generated responses. However, when the AI origin is revealed, this preference diminishes significantly, suggesting that evaluative judgments are influenced by the disclosure of the response's provenance rather than solely by its quality. These results underscore a bias against AI-generated content, highlighting the societal challenge of improving the perception of AI work in contexts where quality assessments should be paramount.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。