构建新数据集CLOFAI,用于持续学习下真假图像分类的评测。
CLOFAI: A Dataset of Real And Fake Image Classification Tasks for Continual Learning
- 设计领域增量任务,模拟真实场景中生成模型迭代更新。
- 对比三种持续学习方法,发现EWC表现差,GEM与经验回放更优。
- 适合研究持续学习、假图像检测及安全应用的开发者使用。
生成式AI模型快速进步,催生了精准区分真实与伪造图像的分类器需求。当分类器遇到训练数据未覆盖的新生成模型图像时,性能通常下降。传统方法需定期更新训练数据并重新训练,但在存储、计算或隐私受限场景下不实用,且安全应用要求快速适应。此时,持续学习成为可行替代方案——无需重训全量数据即可更新模型。本文提出新数据集CLOFAI(Continual Learning On Fake and Authentic Images),以领域增量图像分类任务形式呈现。同时,展示其作为持续学习方法评测基准的适用性。我们基于三种基础持续学习方法(EWC、GEM、Experience Replay)在该数据集上建立基线,结果表明EWC表现不佳,而GEM与经验回放显著优于朴素基线。数据集与代码已开源:https://github.com/Will-Doherty/CLOFAI。
原文摘要 · Abstract (English)
The rapid advancement of generative AI models capable of creating realistic media has led to a need for classifiers that can accurately distinguish between genuine and artificially-generated images. A significant challenge for these classifiers emerges when they encounter images from generative models that are not represented in their training data, usually resulting in diminished performance. A typical approach is to periodically update the classifier's training data with images from the new generative models then retrain the classifier on the updated dataset. However, in some real-life scenarios, storage, computational, or privacy constraints render this approach impractical. Additionally, models used in security applications may be required to rapidly adapt. In these circumstances, continual learning provides a promising alternative, as the classifier can be updated without retraining on the entire dataset. In this paper, we introduce a new dataset called CLOFAI (Continual Learning On Fake and Authentic Images), which takes the form of a domain-incremental image classification problem. Moreover, we showcase the applicability of this dataset as a benchmark for evaluating continual learning methodologies. In doing this, we set a baseline on our novel dataset using three foundational continual learning methods -- EWC, GEM, and Experience Replay -- and find that EWC performs poorly, while GEM and Experience Replay show promise, performing significantly better than a Naive baseline. The dataset and code to run the experiments can be accessed from the following GitHub repository: https://github.com/Will-Doherty/CLOFAI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。