arXiv:2608.08601cs.AIcs.MA2026-08

提出职场AI代理风险分类框架,揭示协作模式如何影响安全

Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents

论文配图:Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents
图 1 · 摘自论文原文
  • 构建三层框架分析代理、目标与环境交互关系
  • 发现增强模式下技能退化风险高于自动化,错误动作最危险
  • 新分类法更易用,适合管理者和设计者评估风险

为应对职场AI代理带来的社会技术风险,现有风险分类体系因缺乏岗位特异性而不足。本文通过文献综述构建包含代理、目标与环境三要素的多层框架,并将其嵌入结构化提示,对O*NET数据库中2,078个岗位任务进行分析,生成8,356个按严重性与部署模式(自动化或增强)标注的风险场景。经45名跨10类岗位员工及独立LLM裁判验证,场景具有高度可实现性。进一步扩展现有分类体系,建立15类职场AI代理风险分类,覆盖所有风险场景。分析显示:增强模式非天然安全,过度依赖导致技能衰退;错误代理行为占最大风险比例且严重度最高,多发生于人机边界;自动化主要引发组织风险,增强则更多威胁员工;用户测试表明本分类在风险识别任务中优于其他两种分类,64%情况下被优先选择。研究强调,风险不仅来自代理本身,更取决于人机协作方式与部署模式。安全工作场所需兼顾代理安全性与协同设计。

原文摘要 · Abstract (English)

To anticipate socio-technical risks from AI agents, organizations need taxonomies to classify them. However, existing AI risk taxonomies focus on broad risks and do not capture job-specific risks introduced by agents. To address this gap, we make three main contributions. First, we developed a multi-layer framework from a literature review of AI agents. The framework models three core components and their interactions: agents, goals, and environment. Second, we embedded this framework in a structured prompt and applied it to descriptions of 2,078 job tasks from the O*NET database, producing 8,356 risk scenarios labeled by severity and deployment mode (automation or augmentation). We validated these scenarios with 45 workers across 10 job roles and an independent LLM judge, confirming their plausibility and alignment with job tasks. Finally, we extended an existing taxonomy to create a 15-category taxonomy of workplace AI agent risks that covers all our risk scenarios. Our analysis highlights four findings. First, augmentation is not inherently safe because overreliance on agents can gradually erode workers' skills and oversight. Second, Erroneous Agent Actions accounts for the largest share of risk scenarios and has the highest concentration of severe risks. Many arise at the human-agent boundary. Third, automation is associated mainly with organizational risks, while augmentation is associated mainly with risks to workers. Fourth, workers found our taxonomy easier to use for a risk classification task than two other taxonomies and preferred it in 64% of non-tied comparisons with a recent generative AI risk taxonomy. These findings show that workplace AI agent risks do not arise from agents alone; they also depend on how people work with agents and how agents are deployed. Safer workplaces require not only safer agents but also carefully designed human-AI agent collaboration.

AI风险人机协作职场智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。