用生命周期模型主动识别生成式虚假信息,提升信息生态韧性。
Generative AI and Digital Ecosystem Resilience: A Proactive Lifecycle-Based Survey
- 构建C5模型整合上下文、诱因、内容等五阶段,统一分析虚假叙事。
- 提出高维嵌入异常检测、多层图无监督协调识别等主动防御技术。
- 适合关注虚假信息治理与数字生态安全的研究者和从业者。
生成式人工智能(GenAI)加速了对抗性合成内容的泛滥,使传统被动检测方法失效。本文通过统一的生命周期框架,融合社会技术模型与先进计算方法,推动对新兴不真实叙事的主动检测范式转变。基于C5交互模型(上下文、诱因、内容、放大周期、后果),整合机器学习与社会科学研究成果。为区分合成内容传播与真实流量,综述了新型叙事的创建、投放与传播建模技术,包括协同不真实行为(CIB)、流行病学建模及霍克斯过程。系统回顾了在C5各阶段的主动检测方法,涵盖高维嵌入空间中的异常检测、多层图上的无监督协调检测以及代理型AI系统。针对GenAI带来的威胁快速演化与多层级分布漂移等挑战,提出未来研究方向:聚焦异常簇检测,构建前瞻性和抗扰的信息生态系统。本综述为增强信息生态韧性提供了全面的生命周期视角下的主动检测方法体系。
原文摘要 · Abstract (English)
The proliferation of adversarial synthetic content, accelerated by Generative AI (GenAI) is rendering traditional reactive detection methods ineffective. This survey synthesizes emerging research to demonstrate a paradigm shift toward the proactive detection of emerging inauthentic narratives. In this survey, we adopt a unified, lifecycle-based taxonomy to combine socio-technical lifecycle models of adversarial campaigns with advanced computational methodologies for emerging inauthentic narrative detection. By structuring the analysis around the C5 Interaction Model (Context, Causes, Content, Cycle of Amplification, Consequences), we integrate different research streams from machine learning and social science. To differentiate spread patterns of synthetic amplification from authentic baseline traffic, this paper surveys state-of-the-art techniques for modeling the creation, seeding, and propagation of fresh narratives, including the analysis of Coordinated Inauthentic Behavior (CIB), epidemiological modeling, and Hawkes process. This survey also provides a systematic review of proactive detection methods for adversarial threats at different stages in the C5 interaction model, specifically, anomaly detection in high-dimensional embedding spaces, unsupervised coordination detection on multi-layer graphs, and agentic AI systems. Finally, this survey addresses challenges posed by GenAI, including the difficulty of tracking rapidly changing threats and multi-level distributional drift, and it outlines a future research agenda focused on detecting anomalous clusters and building anticipatory and resilient systems. This survey provides a comprehensive, lifecycle-based review of methods for the proactive detection of emerging synthetic threats for more resilient information ecosystems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。