arXiv:2412.09961cs.LGcs.AI2024-12中稿 · ACM CS&Law '25被引 12

厘清欧盟AI法案中深伪定义模糊问题,警示透明度义务执行困境

What constitutes a Deep Fake? The blurry line between legitimate processing and manipulation under the EU AI Act

  • 从拍摄到编辑全链路分析数字图像生成过程
  • 当前法案对深伪定义过宽,缺乏明确判断标准
  • 适合政策制定者与AI伦理研究者参考

当数字图像逼近真实时,其界限愈发模糊。随着合成图像(即深伪)日益普及,其可能扰乱政治环境引发关注。为应对风险,欧盟《人工智能法案》对生成或篡改内容实施透明度要求。然而,从计算机视觉角度看,真实与合成图像的区分远非简单。本文分析数字照片从传感器到后期编辑的完整生命周期,发现:(1) 欧盟法案中的深伪定义模糊,界定空间过大;(2) 谷歌“最佳片段”等编辑功能是否可豁免透明度义务尚不明确;(3) “实质性编辑”的例外条款未说明何为实质性,以及是否需自然人可感知。结果表明,当前透明度义务难以落实,可能导致豁免范围过宽或过窄。本文旨在推动对深伪本质的讨论,并警示现行法案的潜在陷阱。

原文摘要 · Abstract (English)

When does a digital image resemble reality? The relevance of this question increases as the generation of synthetic images -- so called deep fakes -- becomes increasingly popular. Deep fakes have gained much attention for a number of reasons -- among others, due to their potential to disrupt the political climate. In order to mitigate these threats, the EU AI Act implements specific transparency regulations for generating synthetic content or manipulating existing content. However, the distinction between real and synthetic images is -- even from a computer vision perspective -- far from trivial. We argue that the current definition of deep fakes in the AI act and the corresponding obligations are not sufficiently specified to tackle the challenges posed by deep fakes. By analyzing the life cycle of a digital photo from the camera sensor to the digital editing features, we find that: (1.) Deep fakes are ill-defined in the EU AI Act. The definition leaves too much scope for what a deep fake is. (2.) It is unclear how editing functions like Google's ``best take'' feature can be considered as an exception to transparency obligations. (3.) The exception for substantially edited images raises questions about what constitutes substantial editing of content and whether or not this editing must be perceptible by a natural person. Our results demonstrate that complying with the current AI Act transparency obligations is difficult for providers and deployers. As a consequence of the unclear provisions, there is a risk that exceptions may be either too broad or too limited. We intend our analysis to foster the discussion on what constitutes a deep fake and to raise awareness about the pitfalls in the current AI Act transparency obligations.

AI监管深伪检测政策分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。