指出生成式AI导致能力退化和成瘾是被忽视的两大风险
Brainrot: Deskilling and Addiction are Overlooked AI Risks
- 识别生成式AI引发的认知卸载与批判性思维弱化问题
- 揭示当前AI安全研究对认知健康风险关注严重不足
- 建议通过安全对齐、信息宣传和监管应对此类隐性风险
生成式人工智能（GenAI）的安全与对齐研究主要聚焦于歧视、有害内容、信息危害及恶意使用等风险。然而公众讨论更多关注技术依赖对认知、心理健康和整体福祉的影响，如因过度依赖GenAI导致的能力退化（deskilling）和心理依赖（addiction）。这些风险在现有文献中几乎未被提及。本文首次量化了这一研究空白，探讨如何将认知与心理健康纳入安全对齐框架，并提出信息传播与政策监管作为缓解路径。
原文摘要 · Abstract (English)
The scope of AI safety and alignment work in generative artificial intelligence (GenAI) has so far mostly been limited to harms related to: (a) discrimination and hate speech, (b) harmful/inappropriate (violent, sexual, illegal) content, (c) information hazards, and (d) use cases related to malicious actors, such as cybersecurity, child abuse, and chemical, biological, radiological, and nuclear threats. The public conversation around AI, on the other hand, has also been focusing on threats to our cognition, mental health, and welfare at large, related to over-relying on new technologies, most recently, those related to GenAI. Examples include deskilling associated with cognitive offloading and the atrophy of critical thinking as a result of over-reliance on GenAI systems, and addiction associated with attachment and dependence on GenAI systems. Such risks are rarely addressed, if at all, in the AI safety and alignment literature. In this paper, we highlight and quantify this discrepancy and discuss some initial thoughts on how safety and alignment work could address cognitive and mental health concerns. Finally, we discuss how information campaigns and regulation can be used to mitigate such prominent risks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。