GenAI生成儿童性虐待内容，开发者也可能担责。
Criminal Liability of Generative Artificial Intelligence Providers for User-Generated Child Sexual Abuse Material
- 从德国法律出发，分析生成式AI在涉童虐内容中的刑事责任
- 用户与模型开发者、研究人员均可能面临刑事追责
- 模型用途、内容审核策略影响责任判定，适合政策制定者参考
生成式人工智能（GenAI）能力的提升带来了更多样化的输出，也引发重大法律挑战，尤其在各国法律体系中对相关责任主体的刑事追责存在灰色地带。本文结合德国相关法律规定与具体场景，研究了在生成儿童性虐待材料（CSAM）情境下GenAI的技术与法律特征。研究发现，利用GenAI生成CSAM不仅使用者需承担主要刑事责任，模型开发者、研究人员及企业代表等责任方也可能被追究刑责。此外，刑事责任的认定受生成图像类型、内容审核机制及模型设计目的等技术与上下文因素影响。基于研究结果，本文讨论了不同角色的责任边界，并提出了开发此类系统时应满足的法律合规要求。
原文摘要 · Abstract (English)
The development of more powerful Generative Artificial Intelligence (GenAI) has expanded its capabilities and the variety of outputs. This has introduced significant legal challenges, including gray areas in various legal systems, such as the assessment of criminal liability for those responsible for these models. Therefore, we conducted a multidisciplinary study utilizing the statutory interpretation of relevant German laws, which, in conjunction with scenarios, provides a perspective on the different properties of GenAI in the context of Child Sexual Abuse Material (CSAM) generation. We found that generating CSAM with GenAI may have criminal and legal consequences not only for the user committing the primary offense but also for individuals responsible for the models, such as independent software developers, researchers, and company representatives. Additionally, the assessment of criminal liability may be affected by contextual and technical factors, including the type of generated image, content moderation policies, and the model's intended purpose. Based on our findings, we discussed the implications for different roles, as well as the requirements when developing such systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。