现有假图检测方法依赖过时的真实图像数据,需重新定义什么是真实影像。
Deepfakes: we need to re-think the concept of "real" images
- 指出当前假图检测依赖老旧低分辨率真实图像数据集
- 强调现代手机拍摄普遍使用神经网络算法,模糊了真实与虚假的界限
- 呼吁重新思考“真实图像”定义,推动新基准数据集建设
现代图像生成模型的普及和低使用门槛引发了对犯罪滥用和负面社会影响的担忧。机器学习领域已推出大量算法方案,用于检测‘假图’——完全生成或部分篡改的图像。尽管技术上有所进展,但现有研究过度聚焦生成算法与‘假’数据样本,忽视了对‘真实’图像的明确定义与数据收集。‘什么是真实图像?’这一看似哲学的问题,实则直接影响所有假图检测方法的评估基础。目前多数检测系统仍依赖少数几类陈旧、低分辨率的真实图像数据集(如ImageNet)。然而过去十年间,真实图像采集技术已发生巨大变革:如今超过90%的照片由智能手机拍摄,其成像过程通常涉及多个传感器、多帧输入,通过神经网络算法合成图像,与生成式模型高度相似。因此,我们主张必须重新审视‘真实图像’的概念。本文旨在揭示该研究领域的关键缺陷,引发关于‘假图检测’是否仍是合理目标的公开讨论。至少,我们需要对‘真实图像’给出清晰的技术定义,并建立新的基准数据集。
原文摘要 · Abstract (English)
The wide availability and low usability barrier of modern image generation models has triggered the reasonable fear of criminal misconduct and negative social implications. The machine learning community has been engaging this problem with an extensive series of publications proposing algorithmic solutions for the detection of "fake", e.g. entirely generated or partially manipulated images. While there is undoubtedly some progress towards technical solutions of the problem, we argue that current and prior work is focusing too much on generative algorithms and "fake" data-samples, neglecting a clear definition and data collection of "real" images. The fundamental question "what is a real image?" might appear to be quite philosophical, but our analysis shows that the development and evaluation of basically all current "fake"-detection methods is relying on only a few, quite old low-resolution datasets of "real" images like ImageNet. However, the technology for the acquisition of "real" images, aka taking photos, has drastically evolved over the last decade: Today, over 90% of all photographs are produced by smartphones which typically use algorithms to compute an image from multiple inputs (over time) from multiple sensors. Based on the fact that these image formation algorithms are typically neural network architectures which are closely related to "fake"-image generators, we state the position that today, we need to re-think the concept of "real" images. The purpose of this position paper is to raise the awareness of the current shortcomings in this active field of research and to trigger an open discussion whether the detection of "fake" images is a sound objective at all. At the very least, we need a clear technical definition of "real" images and new benchmark datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。