AI被用于制造宣传,但主要目的不是骗人,而是高效传播观点。
Generative Propaganda
- 区分了明显与隐蔽、正面与负面的AI宣传类型
- 印度创作者多公开使用AI以降低法律风险,台湾防御方更关注叙事操控
- 提醒安全研究应重视效率提升而非仅关注深度伪造
生成式宣传指利用生成式人工智能影响公众意见。为刻画其在现实中的应用,我们对台湾和印度的辩护者(如事实核查员、记者、官员)及创作者(如影响力人物、政治顾问、广告商)进行了访谈,聚焦两个线上宣传高发地区。研究发现,“深度伪造”一词在塑造防御者对滥用的预期及优先干预措施方面具有显著话语影响力。为此,我们提出一个分类体系,区分明显与隐蔽、促进性与贬损性使用。欺骗并非生成式AI使用的主要动机或影响路径;印度创作者旨在说服而非欺骗,常公开使用以规避法律与声誉风险;而台湾的防御者则视欺骗为在线战略叙事扭曲的一部分。尽管如此,AI仍被用于跨语言与多模态沟通的效率提升,以及规避人工与算法检测。安全研究人员应重新审视威胁模型,明确区分深度伪造与其他明显且具宣传性的使用,强化内部行为人自我约束的社会机制,并在全球范围内应对效率优势带来的挑战。
原文摘要 · Abstract (English)
Generative propaganda is the use of generative artificial intelligence (AI) to shape public opinion. To characterize its use in real-world settings, we conducted interviews with defenders (e.g., factcheckers, journalists, officials) in Taiwan and creators (e.g., influencers, political consultants, advertisers) as well as defenders in India, centering two places characterized by high levels of online propaganda. The term "deepfakes", we find, exerts outsized discursive power in shaping defenders' expectations of misuse and, in turn, the interventions that are prioritized. To better characterize the space of generative propaganda, we develop a taxonomy that distinguishes between obvious versus hidden and promotional versus derogatory use. Deception was neither the main driver nor the main impact vector of AI's use; instead, Indian creators sought to persuade rather than to deceive, often making AI's use obvious in order to reduce legal and reputational risks, while Taiwan's defenders saw deception as a subset of broader efforts to distort the prevalence of strategic narratives online. AI was useful and used, however, in producing efficiency gains in communicating across languages and modes, and in evading human and algorithmic detection. Security researchers should reconsider threat models to clearly differentiate deepfakes from promotional and obvious uses, to complement and bolster the social factors that constrain misuse by internal actors, and to counter efficiency gains globally.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。