微软开发者眼中的多智能体AI像协作团队,透明与可控是关键。
Exploring Human-AI Collaboration Using Mental Models of Early Adopters of Multi-Agent Generative AI Tools
- 将多智能体AI视为角色分工的协作团队,支持从主导到辅助的多种交互模式。
- 发现错误传播、循环行为不可控等挑战,透明度对信任和纠错至关重要。
- 适合关注人机协同设计、AI治理与工作流定制的研究者和开发者。
随着多智能体生成式AI的发展,微软等科技公司正将其作为复杂工作流中的主动合作者,而非被动工具。本研究通过半结构化访谈13名微软早期采用者,探究其对多智能体生成式AI的认知,包括人机协作机制、通用协作动态及透明性。结果表明,这些开发者将多智能体系统理解为由助手、评审员等角色构成的团队,其结构类似人类协作模型,交互模式涵盖从AI主导到用户控制的多种类型。研究识别出关键挑战:错误传播、不可预测的循环行为,以及多层次透明性问题。开发者强调透明性在建立信任、验证与追溯错误、防止误用与泄露中的核心作用。研究提出的设计启示有助于推进人机协作中从全自主到辅助型交互的机制研究,以及跨智能体与人机间监督策略的探索,并为未来扩展协同工作流(CSCW)方法以支持智能体间及人机中介互动提供方向。
原文摘要 · Abstract (English)
With recent advancements in multi-agent generative AI (Gen AI), technology organizations like Microsoft are adopting these complex tools, redefining AI agents as active collaborators in complex workflows rather than as passive tools. In this study, we investigated how early adopters and developers conceptualize multi-agent Gen AI tools, focusing on how they understand human-AI collaboration mechanisms, general collaboration dynamics, and transparency in the context of AI tools. We conducted semi-structured interviews with 13 developers, all early adopters of multi-agent Gen AI technology who work at Microsoft. Our findings revealed that these early adopters conceptualize multi-agent systems as "teams" of specialized role-based and task-based agents, such as assistants or reviewers, structured similar to human collaboration models and ranging from AI-dominant to AI-assisted, user-controlled interactions. We identified key challenges, including error propagation, unpredictable and unproductive agent loop behavior, and the need for clear communication to mitigate the layered transparency issues. Early adopters' perspectives about the role of transparency underscored its importance as a way to build trust, verify and trace errors, and prevent misuse, errors, and leaks. The insights and design considerations we present contribute to CSCW research about collaborative mechanisms with capabilities ranging from AI-dominant to AI-assisted interactions, transparency and oversight strategies in human-agent and agent-agent interactions, and how humans make sense of these multi-agent systems as dynamic, role-diverse collaborators which are customizable for diverse needs and workflows. We conclude with future research directions that extend CSCW approaches to the design of inter-agent and human mediation interactions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。