arXiv:2603.26387eess.IV2026-03

调整特征归一化方式能显著提升边缘设备伪造媒体检测的鲁棒性。

Rethinking Feature Conditioning for Robust Forged Media Detection in Edge AI Sensing Systems

  • 通过控制变量实验,发现特征归一化方式影响检测性能
  • 在跨数据集测试中,不同归一化方法表现差异达6.1个AUC点
  • 适合边缘部署,无需微调,适用于安全敏感场景

在面向边缘智能感知系统的伪造媒体检测中,模型在篡改和数据分布漂移下的泛化能力仍是核心挑战。本文首次对DINOv3 ConvNeXt进行受控探针研究,发现即使不进行任务特定微调,仅用线性探针即可获得具有竞争力的检测性能,表明ViT-7B自监督蒸馏可有效迁移至边缘计算成本可控的安全关键视觉任务。固定主干、头部、数据与优化策略,仅变化特征条件化方式:以LN-Affine(默认输出)为基线,在FaceForensics++ c23上评估五种条件化变体,涵盖同分布测试、留一篡改外(LOMO)及跨数据集迁移至Celeb-DF v2与DeepFakeDetection。在ConvNeXt-Tiny中,条件化方式使LOMO平均AUC变动6.1点,且改变了分布内与分布外性能排序:外部数据集上LN-Affine最优,而分布内则LayerNorm更优。在ConvNeXt-Base复现中,外部最优方案变为协议依赖,且仅以分布内最优选择仍无法保障鲁棒部署。结果表明,特征条件化是首要设计变量,应基于鲁棒性验证选择,而非仅依赖分布内准确率。

原文摘要 · Abstract (English)

Generalization under manipulation and dataset shift remains a core challenge in forged media detection for AI-driven edge sensing systems. Frozen vision foundation models with linear probes are strong baselines, but most pipelines use default backbone outputs without testing conditioning at the frozen feature interface. We present the first controlled probing study on DINOv3 ConvNeXt and show that, without task-specific fine-tuning, linear probing alone yields competitive forged-media detection performance, indicating that ViT-7B self-supervised distillation transfers to security-critical vision workloads at edge-compatible inference cost. Backbone, head, data, and optimization are fixed while conditioning is varied; LN-Affine, the default ConvNeXt head output, is the natural baseline. On FaceForensics++ c23, five conditioning variants are evaluated under in-distribution testing, leave-one-manipulation-out (LOMO), and cross-dataset transfer to Celeb-DF v2 and DeepFakeDetection. In ConvNeXt-Tiny, conditioning alone changes LOMO mean AUC by 6.1 points and reverses ID-vs-OOD ranking: LN-Affine is strongest on external datasets, while LayerNorm is strongest in-distribution. In ConvNeXt-Base replication, the OOD winner becomes protocol-dependent, and ID-optimal selection still fails as a robust deployment rule. Results show that feature conditioning is a first-order design variable and should be selected with robustness-oriented validation, not ID accuracy alone.

伪造检测边缘计算特征归一化鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。