首次揭示AI生成文本在Reddit的分布与影响,发现其峰值达9%且引发社交互动
Machines in the Crowd? Measuring the Footprint of Machine-Generated Text on Reddit
- 用统计方法检测两年内51个社区的AI生成文本
- 部分社区中AI文本占比最高达9%,集中在少数用户
- 虽风格像客服语言,但互动量可超人类内容
生成式人工智能正以低成本大规模生产机器生成文本(MGT),重塑网络交流。本文首次对Reddit上的MGT进行大规模刻画,采用先进统计检测方法,分析2022-2024年51个代表性子版块(涵盖信息获取、社会支持、讨论等)的活动数据。研究显示,尽管总体占比极低,但部分社区在特定月份的MGT比例可达9%;其分布不均,更集中于技术知识与社会支持类板块,且多由少数用户产生。MGT表现出典型AI助手的亲和性与地位赋予特征。尽管存在风格差异,其获得的互动水平与人类内容相当,甚至更高,表明AI文本已融入在线社交话语。本研究为平台治理、检测策略及社区动态研究提供基础视角。
原文摘要 · Abstract (English)
Generative Artificial Intelligence is reshaping online communication by enabling large-scale production of Machine-Generated Text (MGT) at low cost. While its presence is rapidly growing across the Web, little is known about how MGT integrates into social media environments. In this paper, we present the first large-scale characterization of MGT on Reddit. Using a state-of-the-art statistical method for detection of MGT, we analyze over two years of activity (2022-2024) across 51 subreddits representative of Reddit's main community types such as information seeking, social support, and discussion. We study the concentration of MGT across communities and over time, and compared MGT to human-authored text in terms of social signals it expresses and engagement it receives. Our very conservative estimate of MGT prevalence indicates that synthetic text is marginally present on Reddit, but it can reach peaks of up to 9% in some communities in some months. MGT is unevenly distributed across communities, more prevalent in subreddits focused on technical knowledge and social support, and often concentrated in the activity of a small fraction of users. MGT also conveys distinct social signals of warmth and status giving typical of language of AI assistants. Despite these stylistic differences, MGT achieves engagement levels comparable than human-authored content and in a few cases even higher, suggesting that AI-generated text is becoming an organic component of online social discourse. This work offers the first perspective on the MGT footprint on Reddit, paving the way for new investigations involving platform governance, detection strategies, and community dynamics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。