arXiv:2601.09117cs.CYcs.AI2026-01被引 1

分析AI内容平台的有偿创作机制,揭示其催生大量不当内容及性别不公。

A Marketplace for AI-Generated Adult Content and Deepfakes

  • 通过追踪14个月的付费请求,发现用户用工具引导模型生成非训练内容
  • 超半数请求属不适宜工作场所内容,且女性名人成主要目标
  • 平台虽禁深伪内容,但仍有非理性集中出现,凸显治理难题

生成式AI系统日益能够制作高度逼真的合成媒体。Civitai是一个流行的社区驱动型AI内容平台,其名为Bounties的付费功能允许用户支付以委托生成内容。为探究该机制的使用方式及其激励内容,我们对平台上线后14个月内公开可得的所有悬赏请求进行了纵向分析。结果发现,该市场主要被用于引导模型生成原本未训练过的內容。同时,“不适合工作场合”的内容请求广泛存在,并持续增长,现已占所有悬赏的多数。20%的请求者贡献了约一半的请求量,参与度极不均衡。针对“深度伪造”——即描绘可识别真实人物的媒体——的请求集中度更高,其中不乏明确违反平台政策的成人深伪内容。这些请求明显偏向女性名人,暴露出显著的性别不对称社会危害。综合来看,这些发现表明,有偿、社区驱动的生成式AI平台可能产生性别化伤害,引发关于同意、治理与执行的深层问题。

原文摘要 · Abstract (English)

Generative AI systems increasingly enable the production of highly realistic synthetic media. Civitai, a popular community-driven platform for AI-generated content, operates a monetized feature called Bounties, which allows users to commission the generation of content in exchange for payment. To examine how this mechanism is used and what content it incentivizes, we conduct a longitudinal analysis of all publicly available bounty requests collected over a 14-month period following the platform's launch. We find that the bounty marketplace is dominated by tools that let users steer AI models toward content they were not trained to generate. At the same time, requests for content that is "Not Safe For Work" are widespread and have increased steadily over time, now comprising a majority of all bounties. Participation in bounty creation is uneven, with 20% of requesters accounting for roughly half of requests. Requests for "deepfake" - media depicting identifiable real individuals - exhibit a higher concentration than other types of bounties. A nontrivial subset of these requests involves explicit deepfakes despite platform policies prohibiting such content. These bounties disproportionately target female celebrities, revealing a pronounced gender asymmetry in social harm. Together, these findings show how monetized, community-driven generative AI platforms can produce gendered harms, raising questions about consent, governance, and enforcement.

AI伦理深伪内容性别偏见平台治理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。