AI生成的法律证据难辨真伪,人和机器都靠不住。
Can You Trust What You See? Human and AI Detection of Synthetic Legal Evidence

- 构建1400张真实与生成图像数据集,测试真假辨识能力。
- 人类平均准确率64.8%,对强生成器仅48.5%至51.0%。
- 机器检测特异性100%,但漏检率高,需结合人工与溯源技术。
视觉证据长期被视为可靠的法律证据,但人工智能的发展正动摇这一假设。本文研究在民事纠纷常见的以物体为中心场景下,人类与前沿多模态大语言模型(MLLMs)区分真实证据照片与AI生成图像的能力。我们构建了包含200张真实图像与1200张由六种主流文本转图像生成器产生的合成图像的SLED-1400数据集,覆盖十类证据。通过136名普通参与者在线实验及对GPT-5.1、Gemini-3-Pro、Gemini-3-Flash、Qwen3-VL-235B四款MLLM的标准评估发现:人类整体准确率为64.8%,对最强生成器Gemini-3-Pro-Image和Flux-2-Max的识别率分别为48.5%和51.0%,接近随机水平。所有MLLM均未误判真实图像(特异性100%),但对复杂生成物检测率极低,平均仅5.9%。人类与模型错误高度不相关,而四款模型间高度相关。两者均不可独立作为可信认证工具。我们主张法律程序中应视视觉证据为可争议项,并结合训练有素的人工审查、MLLM筛查与如C2PA内容凭证等溯源基础设施建立可行应对机制。
原文摘要 · Abstract (English)
Visual evidence has long been treated as a reliable form of legal proof, but advances in artificial intelligence (AI) are undermining that assumption. This article asks how well humans and frontier multimodal large language models (MLLMs) can distinguish authentic evidentiary photographs from AI-generated counterparts in the object-centric scenarios typical of civil disputes. We built Synthetic Legal Evidence Detection (SLED-1400), a dataset of 200 authentic evidence images paired with 1,200 synthetic counterparts produced by six contemporary text-to-image generators across ten evidence categories. The same stimuli and response format were used in a controlled web experiment with 136 lay participants and in a standardized evaluation of four MLLMs (GPT-5.1, Gemini-3-Pro, Gemini-3-Flash, Qwen3-VL-235B). Human accuracy was 64.8% overall, and 48.5% and 51.0% on the two strongest generators (Gemini-3-Pro-Image and Flux-2-Max), indistinguishable from chance. MLLMs never misclassified an authentic image (100% specificity), but missed most synthetic outputs from the harder generators, with average MLLM detection at 5.9% on Gemini-3-Pro-Image outputs. Human and MLLM errors were largely uncorrelated, while the four MLLMs were strongly correlated with each other. Neither group is a reliable standalone authenticator. We argue that visual evidence in legal proceedings should be treated as inherently contestable, and that a workable procedural response must combine trained human review, MLLM screening, and provenance infrastructure such as C2PA Content Credentials.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。