用DINOv3+LoRA打造图像伪造检测新基准,轻量高效且泛化能力强
DINOv3 Beats Specialized Detectors: A Simple Foundation Model Baseline for Image Forensics

- 基于冻结ViT-L主干+LoRA微调+轻量卷积解码器
- 在四个基准上像素级F1提升17.0点,仅需910万参数
- 对噪声、压缩、模糊等干扰鲁棒,适合研究与应用起步
随着深度生成模型的快速发展,逼真的伪造图像日益普及,但现有定位方法依赖复杂设计,仍难以跨操纵类型和成像条件泛化。本文提出一个简单却强大的基线方法:基于DINOv3,采用LoRA适配和轻量卷积解码器。在CAT-Net协议下,最优模型相比此前最佳方法在四个标准基准上平均像素级F1提升17.0点,仅需910万可训练参数(基于冻结的ViT-L主干);最小变体也超越所有先前专用方法。在数据稀缺的MVSS-Net协议下,LoRA实现平均F1 0.774,远超前人最强方法的0.530,而全参数微调则高度不稳定,表明预训练表征中蕴含的取证信息更宜保留而非覆盖。该基线对高斯噪声、JPEG重压缩及高斯模糊均表现出强鲁棒性。我们希望此工作能成为研究社区可靠的基准,并为未来图像取证应用提供实用起点。代码已开源:https://github.com/Irennnne/DINOv3-IML。
原文摘要 · Abstract (English)
With the rapid advancement of deep generative models, realistic fake images have become increasingly accessible, yet existing localization methods rely on complex designs and still struggle to generalize across manipulation types and imaging conditions. We present a simple but strong baseline based on DINOv3 with LoRA adaptation and a lightweight convolutional decoder. Under the CAT-Net protocol, our best model improves average pixel-level F1 by 17.0 points over the previous state of the art on four standard benchmarks using only 9.1\,M trainable parameters on top of a frozen ViT-L backbone, and even our smallest variant surpasses all prior specialized methods. LoRA consistently outperforms full fine-tuning across all backbone scales. Under the data-scarce MVSS-Net protocol, LoRA reaches an average F1 of 0.774 versus 0.530 for the strongest prior method, while full fine-tuning becomes highly unstable, suggesting that pre-trained representations encode forensic information that is better preserved than overwritten. The baseline also exhibits strong robustness to Gaussian noise, JPEG re-compression, and Gaussian blur. We hope this work can serve as a reliable baseline for the research community and a practical starting point for future image-forensic applications. Code is available at https://github.com/Irennnne/DINOv3-IML.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。