用原型锚定球面边界,持续识别新型AI生成视频。
SphereVideo: Prototype-anchored Hyperspherical Boundary for Continual AI-generated Video Detection

- 以真实视频原型为锚点,在超球面上构建决策边界。
- 在已见和未见数据上分别提升3.08%和4.00%准确率。
- 适合需要持续更新的AI视频检测系统使用。
AI生成视频检测旨在区分真实视频与生成视频。实践中,基于已有数据训练的检测器往往难以泛化到新出现的生成模型,导致任务挑战性高。因此,持续学习(CL)对提升适应性至关重要,但该任务的CL框架仍待探索。为此,我们提出SphereVideo,一种基于两个关键观察的新型CL框架。首先,真实视频具有紧凑的特征分布,我们引导真实视频特征在超球面上聚集于真实原型,同时排斥生成样本,从而建立决策边界;该原型作为稳定锚点,调控边界演化并缓解灾难性遗忘。其次,现有方法常依赖空间伪影作为捷径,为此我们引入帧级与片段级双重时序建模策略,增强真实数据建模能力,进一步促进原型学习与边界稳定。此外,我们构建了一个全面且具挑战性的基准。大量实验表明,SphereVideo实现了更优的可塑性-稳定性权衡,在已见数据上优于基线3.08%,在未见生成数据上提升4.00%。
原文摘要 · Abstract (English)
AI-generated video (AIGV) detection aims to distinguish real videos from AI-generated ones. In practice, detectors trained on existing data often fail to generalize to newly emerging generative models, making this task challenging. Therefore, continual learning (CL) is essential for improving the adaptability. However, CL frameworks for this task remain underexplored. To this end, we propose SphereVideo, a novel CL framework for AIGV detection built on two key observations. First, real videos exhibit a compact feature distribution. Based on this, we encourage real video features to cluster around a real prototype on a hypersphere while repelling AI-generated samples, thereby establishing a decision boundary. This prototype serves as a stable anchor for CL, regulating boundary evolution and mitigating catastrophic forgetting. Second, existing methods tend to rely solely on spatial artifacts as shortcuts. To enhance temporal modeling, we introduce a strategy that models the temporal dynamics of real data at both frame and clip levels. By strengthening real data modeling, this strategy further facilitates learning a real prototype and forming a stable decision boundary. Moreover, we construct a comprehensive and challenging benchmark. Extensive experiments demonstrate that SphereVideo achieves an improved plasticity-stability trade-off, outperforming prior methods by 3.08% on seen data and 4.00% on unseen AI-generated data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。