arXiv:2601.15064cs.HCcs.AI2026-01被引 4

设计有效激励方案,提升人机决策研究的可信度。

Incentive-Tuning: Understanding and Designing Incentives for Empirical Human-AI Decision-Making Studies

  • 通过主题分析提炼激励设计的关键要素与模式。
  • 提出可复用的「激励调优框架」指导研究设计。
  • 适合开展人机协作实验的研究者参考使用。

人工智能已革新多个领域的决策流程,但高风险决策仍依赖人类判断。为此,学界开展大量实证研究,探索人类如何借助AI辅助决策及其对结果的影响。研究有效性高度依赖参与者行为,而激励机制正是影响行为的核心因素。本文通过主题式综述,系统分析现有研究中的激励实践、挑战与机遇,提炼出激励方案的构成要素、研究人员的操作方式及其对研究结果的潜在影响。基于此,我们构建了「激励调优框架」(Incentive-Tuning Framework),为研究者提供一套可操作、可反思、可记录的激励设计指南。倡导标准化但灵活的激励设计方法,旨在推动人机决策研究向更可靠、可推广的方向发展。

原文摘要 · Abstract (English)

AI has revolutionised decision-making across various fields. Yet human judgement remains paramount for high-stakes decision-making. This has fueled explorations of collaborative decision-making between humans and AI systems, aiming to leverage the strengths of both. To explore this dynamic, researchers conduct empirical studies, investigating how humans use AI assistance for decision-making and how this collaboration impacts results. A critical aspect of conducting these studies is the role of participants, often recruited through crowdsourcing platforms. The validity of these studies hinges on the behaviours of the participants, hence effective incentives that can potentially affect these behaviours are a key part of designing and executing these studies. In this work, we aim to address the critical role of incentive design for conducting empirical human-AI decision-making studies, focusing on understanding, designing, and documenting incentive schemes. Through a thematic review of existing research, we explored the current practices, challenges, and opportunities associated with incentive design for human-AI decision-making empirical studies. We identified recurring patterns, or themes, such as what comprises the components of an incentive scheme, how incentive schemes are manipulated by researchers, and the impact they can have on research outcomes. Leveraging the acquired understanding, we curated a set of guidelines to aid researchers in designing effective incentive schemes for their studies, called the Incentive-Tuning Framework, outlining how researchers can undertake, reflect on, and document the incentive design process. By advocating for a standardised yet flexible approach to incentive design and contributing valuable insights along with practical tools, we hope to pave the way for more reliable and generalizable knowledge in the field of human-AI decision-making.

人机协作实验设计激励机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。