提出多步透明决策流程,提升复杂任务中人机协作的合理依赖度。
Fine-Grained Appropriate Reliance: Human-AI Collaboration with a Multi-Step Transparent Decision Workflow for Complex Task Decomposition
- 设计多步透明决策流程,让用户逐层审视AI建议。
- 实验显示该流程在误导性建议下表现优于单步协作。
- 适合关注人机信任与协作设计的研究者和开发者。
近年来,人工智能系统的快速发展带来了智能服务的便利,也引发了安全与可靠性方面的担忧。通过促进用户对AI系统的合理依赖,可实现人机协同性能提升与人力负担降低。以往研究多聚焦于单步决策中的信任与合理依赖影响因素,但对需多步流程的复杂语义任务中的人机依赖行为仍缺乏探索。受大语言模型任务分解工作的启发,本文提出多步透明(MST)决策流程,考察其对用户依赖行为的影响。我们开展了一项针对复合事实核查任务(包含多个子事实验证步骤)的人机协作实证研究(N=233)。结果表明,在特定情境下(如AI建议存在误导时),采用MST流程的人机协作优于单步协作。进一步细粒度分析显示,当用户重视中间步骤时,MST流程效果更显著。研究指出,不存在普适最优的决策流程,应根据上下文动态设计。本工作为复合任务中促进合理依赖提供了重要启示,推动了以用户为中心的AI与人机交互领域的发展。
原文摘要 · Abstract (English)
In recent years, the rapid development of AI systems has brought about the benefits of intelligent services but also concerns about security and reliability. By fostering appropriate user reliance on an AI system, both complementary team performance and reduced human workload can be achieved. Previous empirical studies have extensively analyzed the impact of factors ranging from task, system, and human behavior on user trust and appropriate reliance in the context of one-step decision making. However, user reliance on AI systems in tasks with complex semantics that require multi-step workflows remains under-explored. Inspired by recent work on task decomposition with large language models, we propose to investigate the impact of a novel Multi-Step Transparent (MST) decision workflow on user reliance behaviors. We conducted an empirical study (N = 233) of AI-assisted decision making in composite fact-checking tasks (i.e., fact-checking tasks that entail multiple sub-fact verification steps). Our findings demonstrate that human-AI collaboration with an MST decision workflow can outperform one-step collaboration in specific contexts (e.g., when advice from an AI system is misleading). Further analysis of the appropriate reliance at fine-grained levels indicates that an MST decision workflow can be effective when users demonstrate a relatively high consideration of the intermediate steps. Our work highlights that there is no one-size-fits-all decision workflow that can help obtain optimal human-AI collaboration. Our insights help deepen the understanding of the role of decision workflows in facilitating appropriate reliance. We synthesize important implications for designing effective means to facilitate appropriate reliance on AI systems in composite tasks, positioning opportunities for the human-centered AI and broader HCI communities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。