披露AI助写会降低人们对文章质量的评价，尤其在内容由AI生成时。
How Does the Disclosure of AI Assistance Affect the Perceptions of Writing?
- 通过实验研究披露AI助写程度与类型对感知的影响。
- 披露AI生成内容使文章平均评分下降，评价差异增大。
- 写作自信和熟悉AI者受披露影响更小，顶尖文章中AI生成内容减少。
近年来，生成式AI技术如大语言模型推动了AI辅助写作的广泛应用，催生了人机协同创作的新范式。为理解人们对此类写作的感知，本文开展实验研究，探讨披露写作过程中AI协助的程度与类型是否以及如何影响人们对文章质量、排名等方面的评价。结果表明，披露AI辅助，特别是内容生成类协助，会降低论说文与创意故事的平均质量评分，且个体间评价差异显著增大。个人写作自信及对AI写作助手的熟悉度可调节披露带来的影响。此外，披露使用AI生成内容会显著降低此类文章在高分作品中的比例。
原文摘要 · Abstract (English)
Recent advances in generative AI technologies like large language models have boosted the incorporation of AI assistance in writing workflows, leading to the rise of a new paradigm of human-AI co-creation in writing. To understand how people perceive writings that are produced under this paradigm, in this paper, we conduct an experimental study to understand whether and how the disclosure of the level and type of AI assistance in the writing process would affect people's perceptions of the writing on various aspects, including their evaluation on the quality of the writing and their ranking of different writings. Our results suggest that disclosing the AI assistance in the writing process, especially if AI has provided assistance in generating new content, decreases the average quality ratings for both argumentative essays and creative stories. This decrease in the average quality ratings often comes with an increased level of variations in different individuals' quality evaluations of the same writing. Indeed, factors such as an individual's writing confidence and familiarity with AI writing assistants are shown to moderate the impact of AI assistance disclosure on their writing quality evaluations. We also find that disclosing the use of AI assistance may significantly reduce the proportion of writings produced with AI's content generation assistance among the top-ranked writings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。