实证研究AI开发中人的角色，提炼出4大关键主题。
Exploring Human-in-the-Loop Themes in AI Application Development: An Empirical Thematic Analysis
- 通过日记与访谈分析1435个关键词，提炼出人机协作主题。
- 发现系统全生命周期中人类决策权需明确界定，否则易出错。
- 适合关注人机协同、AI治理的开发者和管理者参考。
在组织中开发与部署AI应用时，若系统全生命周期内人类决策权与监督职责不明确，将面临挑战。尽管人机协同（HITL）与以人为本的AI（HCAI）理念广受认可，但关于角色分工、检查点设置及反馈机制的操作指导仍零散。本文开展多源定性研究：对一个客户支持聊天机器人进行回顾性日记研究，并对来自学术界与产业界的八位AI专家进行半结构化访谈。通过对1435个编码词进行五轮主题分析，提炼出四个核心主题：人工智能治理与人类权威、人机协同迭代优化、AI系统全生命周期与操作约束、人机团队协作与协调。这些主题为后续人机协同框架的设计与验证提供了实证依据。
原文摘要 · Abstract (English)
Developing and deploying AI applications in organizations is challenging when human decision authority and oversight are underspecified across the system lifecycle. Although Human-in-the-Loop (HITL) and Human-Centered AI (HCAI) principles are widely acknowledged, operational guidance for structuring roles, checkpoints, and feedback mechanisms remains fragmented. We report a multi-source qualitative study: a retrospective diary study of a customer-support chatbot and semi-structured interviews with eight AI experts from academia and industry. Through five-cycle thematic analysis of 1,435 codewords, we derive four themes: AI Governance and Human Authority, Human-in-the-Loop Iterative Refinement, AI System Lifecycle and Operational Constraints, and Human-AI Team Collaboration and Coordination. These themes provide empirical inputs for subsequent HITL framework design and validation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。