SAGA可精准识别生成视频的模型来源,助力内容溯源与监管。
SAGA: Source Attribution of Generative AI Videos
- 基于视觉基础模型构建视频变换器,捕捉时空伪影特征。
- 仅需0.5%标注数据即可达到全监督性能,数据效率极高。
- 提供可解释的时序差异可视化,适合安全与司法场景使用。
生成式AI的泛滥催生了高度逼真的合成视频,加剧滥用风险,远超传统真假二分类检测能力。我们提出SAGA(生成视频源溯源),首个大规模实现生成视频源归属的综合性框架。不同于传统检测,SAGA可识别具体生成模型。其在五个粒度层级上实现溯源:真实性、生成任务(如T2V/I2V)、模型版本、开发团队及精确生成器,提供更丰富的取证信息。创新的视频变换器架构融合强健视觉基础模型特征,有效捕捉时空伪影。关键提出数据高效预训练-溯源策略,仅用每类0.5%的标注数据即达全监督性能。此外,提出时序注意力签名(T-Sigs)新可解释方法,首次可视化不同生成器的学习差异。在公开数据集上的广泛实验,包括跨域场景,验证SAGA为合成视频溯源设立新基准,为取证与监管应用提供关键且可解释的洞察。
原文摘要 · Abstract (English)
The proliferation of generative AI has led to hyper-realistic synthetic videos, escalating misuse risks and outstripping binary real/fake detectors. We introduce SAGA (Source Attribution of Generative AI videos), the first comprehensive framework to address the urgent need for AI-generated video source attribution at a large scale. Unlike traditional detection, SAGA identifies the specific generative model used. It uniquely provides multi-granular attribution across five levels: authenticity, generation task (e.g., T2V/I2V), model version, development team, and the precise generator, offering far richer forensic insights. Our novel video transformer architecture, leveraging features from a robust vision foundation model, effectively captures spatio-temporal artifacts. Critically, we introduce a data-efficient pretrain-and-attribute strategy, enabling SAGA to achieve state-of-the-art attribution using only 0.5\% of source-labeled data per class, matching fully supervised performance. Furthermore, we propose Temporal Attention Signatures (T-Sigs), a novel interpretability method that visualizes learned temporal differences, offering the first explanation for why different video generators are distinguishable. Extensive experiments on public datasets, including cross-domain scenarios, demonstrate that SAGA sets a new benchmark for synthetic video provenance, providing crucial, interpretable insights for forensic and regulatory applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。