用KAN网络防伪造检测中的遗忘问题,无需旧数据就能持续学习新造假手法。
Unifying Locality of KANs and Feature Drift Compensation Projection for Data-free Replay based Continual Face Forgery Detection
- 设计局部可塑的KAN网络,仅修改局部函数应对新伪造类型
- 在不使用旧数据情况下,使新旧伪造检测准确率分别达96.3%和95.7%
- 适合需要长期更新的伪造检测系统,尤其无数据回放场景
面部伪造技术的快速演进要求检测器持续适应新伪造方法,因而需采用持续学习范式。然而,当检测器学习新伪造类型时,对旧类型的性能常急剧下降,即灾难性遗忘。柯尔莫戈罗夫-阿诺德网络(KAN)采用局部可塑样条作为激活函数,可通过仅修改函数局部区域来学习新任务,保持其他部分不变,天然适用于缓解灾难性遗忘。但现有KAN存在两大局限:1)样条难以建模高维图像,而适配图像的替代激活函数缺乏局部性;2)持续学习中,不同域特征重叠时,因反复修改相同区域,导致不同域映射到不同曲线区域的分离机制失效。本文提出基于KAN的持续面部伪造检测框架(KAN-CFD),包含领域分组KAN检测器(DG-KD)与无需数据的特征分离策略——通过KAN漂移补偿投影(FS-KDCP)。DG-KD使KAN能处理高维图像输入,同时保留局部性与局部可塑性;FS-KDCP在不依赖旧任务数据的前提下,避免各领域输入空间重叠。实验表明,所提方法在保持高性能的同时显著减少遗忘。
原文摘要 · Abstract (English)
The rapid advancements in face forgery techniques necessitate that detectors continuously adapt to new forgery methods, thus situating face forgery detection within a continual learning paradigm. However, when detectors learn new forgery types, their performance on previous types often degrades rapidly, a phenomenon known as catastrophic forgetting. Kolmogorov-Arnold Networks (KANs) utilize locally plastic splines as their activation functions, enabling them to learn new tasks by modifying only local regions of the functions while leaving other areas unaffected. Therefore, they are naturally suitable for addressing catastrophic forgetting. However, KANs have two significant limitations: 1) the splines are ineffective for modeling high-dimensional images, while alternative activation functions that are suitable for images lack the essential property of locality; 2) in continual learning, when features from different domains overlap, the mapping of different domains to distinct curve regions always collapses due to repeated modifications of the same regions. In this paper, we propose a KAN-based Continual Face Forgery Detection (KAN-CFD) framework, which includes a Domain-Group KAN Detector (DG-KD) and a data-free replay Feature Separation strategy via KAN Drift Compensation Projection (FS-KDCP). DG-KD enables KANs to fit high-dimensional image inputs while preserving locality and local plasticity. FS-KDCP avoids the overlap of the KAN input spaces without using data from prior tasks. Experimental results demonstrate that the proposed method achieves superior performance while notably reducing forgetting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。