用双层优化自监督学习,让模型更好识别新生成的AI人脸。
Bi-Level Optimization for Self-Supervised AI-Generated Face Detection
- 内层用EXIF标签任务预训练视觉编码器,外层优化任务权重以逼近目标
- 在未见生成器上表现优于现有方法,一分类和二分类均提升明显
- 适合需要强泛化能力的AI人脸检测场景,如安全审核与内容风控
基于双层优化的自监督方法解决当前监督学习中依赖特定生成器导致泛化性差的问题。内层通过线性加权的预训练任务(包括可交换文件格式标签分类、有序EXIF标签排序、人工面部篡改检测)仅使用真实人脸照片训练视觉编码器。外层则优化这些预训练任务的相对权重,以增强对粗粒度伪造人脸的检测能力,作为识别AI生成人脸的代理任务。预训练完成后,编码器固定,通过高斯混合模型建模真实人脸特征进行异常检测,或使用轻量两层感知机作为二分类器。大量实验表明,该方法在单类与二分类设置下显著优于现有技术,在未见生成器上也展现出强大泛化能力。
原文摘要 · Abstract (English)
AI-generated face detectors trained via supervised learning typically rely on synthesized images from specific generators, limiting their generalization to emerging generative techniques. To overcome this limitation, we introduce a self-supervised method based on bi-level optimization. In the inner loop, we pretrain a vision encoder only on photographic face images using a set of linearly weighted pretext tasks: classification of categorical exchangeable image file format (EXIF) tags, ranking of ordinal EXIF tags, and detection of artificial face manipulations. The outer loop then optimizes the relative weights of these pretext tasks to enhance the coarse-grained detection of manipulated faces, serving as a proxy task for identifying AI-generated faces. In doing so, it aligns self-supervised learning more closely with the ultimate goal of AI-generated face detection. Once pretrained, the encoder remains fixed, and AI-generated faces are detected either as anomalies under a Gaussian mixture model fitted to photographic face features or by a lightweight two-layer perceptron serving as a binary classifier. Extensive experiments demonstrate that our detectors significantly outperform existing approaches in both one-class and binary classification settings, exhibiting strong generalization to unseen generators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。