通过分析生成图像的潜在特征痕迹,实现对伪造人脸的精准溯源。
Proto-LeakNet: Towards Signal-Leak Aware Attribution in Synthetic Human Face Imagery
- 在扩散模型潜空间重构生成痕迹,利用时序注意力捕捉多步特征。
- 仅用封闭数据训练即达98.13%宏AUC,对未知生成器仍具强区分能力。
- 适用于检测深度伪造内容,尤其适合需要可解释性的安全场景。
随着合成图像与深度伪造生成模型日益复杂,源归属与真实性验证已成为现代计算机视觉系统的关键挑战。近期研究表明,扩散模型在生成过程中会无意留下持久的统计痕迹,称为信号泄漏,尤其体现在潜在表示中。基于此,我们提出Proto-LeakNet,一种面向信号泄漏且可解释的归属框架,结合闭集分类与基于密度的开集评估,无需重新训练即可分析未见过的生成器。该方法在扩散模型的潜空间内重演部分前向扩散过程,以暴露残留的生成器特有线索。时间注意力编码器聚合多步潜在特征,特征加权原型头构建嵌入空间并实现透明归属。仅在封闭数据上训练即达到98.13%宏AUC,其学习到的潜空间几何结构在后处理下依然稳健,优于现有最先进方法,在真实图像与已知生成器之间、以及已知与未知生成器之间均表现出强可分性。代码已公开于:https://github.com/claudiunderthehood/Proto-LeakNet。
原文摘要 · Abstract (English)
The growing sophistication of synthetic image and deepfake generation models has turned source attribution and authenticity verification into a critical challenge for modern computer vision systems. Recent studies suggest that diffusion pipelines unintentionally imprint persistent statistical traces, known as signal-leaks, within their outputs, particularly in latent representations. Building on this observation, we propose Proto-LeakNet, a signal-leak-aware and interpretable attribution framework that integrates Closed-set classification with a density-based Open-set evaluation on the learned embeddings, enabling analysis of unseen generators without retraining. Acting in the latent domain of diffusion models, our method re-simulates partial forward diffusion to expose residual generator-specific cues. A temporal attention encoder aggregates multi-step latent features, while a feature-weighted prototype head structures the embedding space and enables transparent attribution. Trained solely on closed data and achieving a Macro AUC of 98.13\%, Proto-LeakNet learns a latent geometry that remains robust under post-processing, surpassing state-of-the-art methods, and achieves strong separability both between real images and known generators, and between known and unseen ones. The codebase is available at the following link: https://github.com/claudiunderthehood/Proto-LeakNet .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。