用像素差分+视觉变换器,精准识别图像来源相机。
PDC-ViT : Source Camera Identification using Pixel Difference Convolution and Vision Transformer
- 结合像素差分卷积提取细微图像特征
- 在多个数据集上达到最高94.3%识别准确率
- 适合刑侦取证与设备溯源场景
源相机识别在恐怖主义、暴力等重大案件中具有重要意义,有助于执法部门获取证据并还原事件时间线。通过识别特定设备的拥有者,可缩小刑事案件中智能手机的调查范围。本文提出一种基于像素的新方法PDC-ViT,融合像素差分卷积(PDC)与视觉变换器(ViT)网络。PDC作为特征提取主干,利用角度差分(APDC)和径向差分(RPDC)捕捉像素级微小差异,提升相机间区分能力;分类部分则将PDC特征输入ViT网络,而非直接使用图像块。该方法在五个不同数据集上验证,涵盖多样图像内容与视频场景,对比当前最优方法,结果表明其在准确率与鲁棒性上均具优势。例如,在Vision、Daxing、Socrates和QUFVD数据集上分别取得94.30%、84%、94.22%和92.29%的识别准确率。
原文摘要 · Abstract (English)
Source camera identification has emerged as a vital solution to unlock incidents involving critical cases like terrorism, violence, and other criminal activities. The ability to trace the origin of an image/video can aid law enforcement agencies in gathering evidence and constructing the timeline of events. Moreover, identifying the owner of a certain device narrows down the area of search in a criminal investigation where smartphone devices are involved. This paper proposes a new pixel-based method for source camera identification, integrating Pixel Difference Convolution (PDC) with a Vision Transformer network (ViT), and named PDC-ViT. While the PDC acts as the backbone for feature extraction by exploiting Angular PDC (APDC) and Radial PDC (RPDC). These techniques enhance the capability to capture subtle variations in pixel information, which are crucial for distinguishing between different source cameras. The second part of the methodology focuses on classification, which is based on a Vision Transformer network. Unlike traditional methods that utilize image patches directly for training the classification network, the proposed approach uniquely inputs PDC features into the Vision Transformer network. To demonstrate the effectiveness of the PDC-ViT approach, it has been assessed on five different datasets, which include various image contents and video scenes. The method has also been compared with state-of-the-art source camera identification methods. Experimental results demonstrate the effectiveness and superiority of the proposed system in terms of accuracy and robustness when compared to its competitors. For example, our proposed PDC-ViT has achieved an accuracy of 94.30%, 84%, 94.22% and 92.29% using the Vision dataset, Daxing dataset, Socrates dataset and QUFVD dataset, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。