arXiv:2510.02978cs.CYcs.AI2025-10被引 11

AI生成儿童性虐待内容虽无真实受害者,但危害远超想象。

AI Generated Child Sexual Abuse Material -- What's the Harm?

  • 分析生成式AI制造虚假儿童性虐待内容的技术路径与风险
  • 揭示其可能诱发犯罪、加剧受害、降低犯罪门槛等多重危害
  • 警示将AI CSAM视为'无害'的错误认知,呼吁加强监管

能够生成完全或部分合成儿童性虐待材料(AI CSAM)的生成式人工智能工具,对儿童保护、执法及社会应对儿童剥削构成严峻挑战。尽管有人认为其因无真实受害者而危害不同,但这一观点忽视了其在制造未受虐儿童的合成图像、重创已知受害者、助长诱骗、胁迫和性勒索,以及使儿童性剥削正常化等方面的多重风险。此外,AI CSAM可能成为犯罪的入门路径,降低参与门槛,使用户对极端内容逐渐麻木,并削弱有恋童倾向者的心理防线。本文梳理关键技术,批判性分析相关危害,反对将其视为‘减害工具’的说法,强调将之视为无害会掩盖真实风险,导致生态系统响应迟滞。

原文摘要 · Abstract (English)

The development of generative artificial intelligence (AI) tools capable of producing wholly or partially synthetic child sexual abuse material (AI CSAM) presents profound challenges for child protection, law enforcement, and societal responses to child exploitation. While some argue that the harmfulness of AI CSAM differs fundamentally from other CSAM due to a perceived absence of direct victimization, this perspective fails to account for the range of risks associated with its production and consumption. AI has been implicated in the creation of synthetic CSAM of children who have not previously been abused, the revictimization of known survivors of abuse, the facilitation of grooming, coercion and sexual extortion, and the normalization of child sexual exploitation. Additionally, AI CSAM may serve as a new or enhanced pathway into offending by lowering barriers to engagement, desensitizing users to progressively extreme content, and undermining protective factors for individuals with a sexual interest in children. This paper provides a primer on some key technologies, critically examines the harms associated with AI CSAM, and cautions against claims that it may function as a harm reduction tool, emphasizing how some appeals to harmlessness obscure its real risks and may contribute to inertia in ecosystem responses.

AI伦理儿童安全内容生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。