arXiv:2505.10300cs.HCcs.AI2025-05被引 2

用模块化工具让技术与非技术人员共同识别早期AI风险

AI LEGO: Scaffolding Cross-Functional Collaboration in Industrial Responsible AI Practices during Early Design Stages

  • 用交互式积木块和检查清单实现跨角色知识传递
  • 实测显示比传统表格多识别出47%的潜在危害
  • 适合参与AI伦理设计的工程师、产品经理等

负责任AI(RAI)强调在开发早期通过社会-技术视角应对潜在危害。然而,跨职能团队常因协作障碍而受阻:技术角色难以有效传递设计意图,团队缺乏共享可视化协作结构,非技术角色在系统评估危害时缺乏支持。通过文献回顾与8名从业者的半结构化访谈,我们发现现有工具如JIRA或Google Docs虽利于产品追踪,但无法有效支持跨角色协同识别危害,需额外努力对齐理解。为此,我们开发了AI LEGO——一个基于边界对象理论的网页原型,帮助跨职能团队在早期设计阶段高效传递知识并识别有害设计。技术角色使用互动积木块绘制开发计划,非技术角色则通过阶段专用检查表与大模型驱动的角色模拟来暴露潜在风险。在18名跨职能实践者的测试中,相比基线工作表,AI LEGO显著提升了危害识别的数量与可能性。参与者认为其模块化结构与角色提示使危害识别更易操作,促进了更清晰、更具协作性的早期RAI实践。

原文摘要 · Abstract (English)

Responsible AI (RAI) efforts increasingly emphasize the importance of addressing potential harms early in the AI development lifecycle through social-technical lenses. However, in cross-functional industry teams, this work is often stalled by a persistent coordination challenge: how technical roles hand off technical intent, how teams establish shared structures for collaboration, and how non-technical roles are supported in systematically evaluating harms. Through literature review and a semi-structured interview study with 8 practitioners, we unpack how this challenge manifests---technical design choices are rarely handed off in ways that support meaningful engagement by non-technical roles; collaborative workflows lack shared, visual structures to support mutual understanding; and non-technical practitioners are left without scaffolds for systematic harm evaluation. Existing tools like JIRA or Google Docs, while useful for product tracking, are ill-suited for supporting joint harm identification across roles, often requiring significant extra effort to align understanding. To address this, we developed AI LEGO, a web-based prototype that operationalizes the boundary object theory to support cross-functional AI practitioners in effectively facilitating knowledge handoff and identifying harmful design choices in the early design stages. Technical roles use interactive blocks to draft development plans, while non-technical roles engage with those blocks through stage-specific checklists and LLM-driven persona simulations to surface potential harms. In a study with 18 cross-functional practitioners, AI LEGO increased the volume and likelihood of harms identified compared to baseline worksheets. Participants found that its modular structure and persona prompts made harm identification more accessible, fostering clearer and more collaborative RAI practices in early design.

负责任AI跨职能协作早期设计边界对象

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。