arXiv:2505.23733cs.CYcs.AI2025-05被引 1

生成式AI降低黑客门槛,导致网络犯罪数量激增。

Unintentional Consequences: Generative AI Use for Cybercrime

  • 基于技术放大理论,分析生成式AI如何让犯罪者更易实施攻击。
  • 释放后每周恶意IP报告增超112万,加密货币诈骗报告增约722起。
  • 研究为平台监管与人工智能治理提供早期预警参考。

生成式AI的普及带来了人机交互新形态,也引发紧迫的安全、伦理与网络安全问题。本文构建社会技术框架,解释生成式AI如何促成并扩大网络犯罪。基于可用性理论与技术放大效应,我们指出生成式AI通过降低技术门槛、提升攻击效率,为网络犯罪者创造新的行动可能,并放大其既有恶意意图。为验证该框架,我们对两个大规模数据集进行中断时间序列分析:(1)来自AbuseIPDB的4.64亿条恶意IP地址报告;(2)来自Chainabuse的28.1万条加密货币诈骗报告。以2022年11月30日作为公众可访问的重大节点事件,估算在无该技术释放情况下的反事实轨迹,评估通用人工智能技术的早期影响。结果显示,在两组数据中均出现显著的干预后增长,包括每周恶意IP报告立即增加超过112万,加密货币诈骗报告每周增加约722起,后者呈现持续上升趋势。研究讨论了对人工智能治理、平台监管及网络韧性建设的启示,强调需采取多层次的社会技术策略,帮助关键利益相关方在享受AI红利的同时,有效应对日益增长的网络犯罪风险。

原文摘要 · Abstract (English)

The democratization of generative AI introduces new forms of human-AI interaction and raises urgent safety, ethical, and cybersecurity concerns. We develop a socio-technical explanation for how generative AI enables and scales cybercrime. Drawing on affordance theory and technological amplification, we argue that generative AI systems create new action possibilities for cybercriminals and magnify pre-existing malicious intent by lowering expertise barriers and increasing attack efficiency. To illustrate this framework, we conduct interrupted time series analyses of two large datasets: (1) 464,190,074 malicious IP address reports from AbuseIPDB, and (2) 281,115 cryptocurrency scam reports from Chainabuse. Using November 30, 2022, as a high-salience public-access shock, we estimate the counterfactual trajectory of reported cyber abuse absent the release, providing an early-warning impact assessment of a general-purpose AI technology. Across both datasets, we observe statistically significant post-intervention increases in reported malicious activity, including an immediate increase of over 1.12 million weekly malicious IP reports and about 722 weekly cryptocurrency scam reports, with sustained growth in the latter. We discuss implications for AI governance, platform-level regulation, and cyber resilience, emphasizing the need for multi-layer socio-technical strategies that help key stakeholders maximize AI's benefits while mitigating its growing cybercrime risks.

生成式AI网络犯罪安全风险

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。