arXiv:2412.19530cs.HCcs.LG2024-12

AI建议需个性化与价值导向,否则反会拖累专家决策

The Value of AI Advice: Personalized and Value-Maximizing AI Advisors Are Necessary to Reliably Benefit Experts and Organizations

  • 设计时需评估建议对真实场景的价值,而非仅看性能
  • 缺乏个性化和成本权衡的AI建议可能降低专家效率
  • 适合需要可靠辅助决策的高风险领域从业者

尽管人工智能在性能和可解释性上取得进展,但其建议仍可能削弱专家判断,并增加专家决策所需的时间与精力。因此,许多部署于高风险场景的AI系统未能持续为专家和组织创造价值,甚至削弱专家独立贡献的价值。这种现象不仅限于特定领域,更阻碍了研究与实践的进展。为此,本文强调必须在设计与评估中考察AI建议在现实情境中的实际价值。基于此,我们提出关键支柱——影响价值的路径,并构建一个融合这些支柱的框架,以实现可靠、个性化且能增值的AI顾问。结果表明,成功的AI建议需具备选择性、针对专家行为定制,并优化上下文中的决策提升与建议成本之间的权衡。同时揭示,当前系统设计若忽略这些要素,正是导致实际应用失败的原因。

原文摘要 · Abstract (English)

Despite advances in AI's performance and interpretability, AI advisors can undermine experts' decisions and increase the time and effort experts must invest to make decisions. Consequently, AI systems deployed in high-stakes settings often fail to consistently add value across experts and organizations and can even diminish the value that experts alone provide. Beyond harm in specific domains, such outcomes impede progress in research and practice, underscoring the need to understand when and why different AI advisors add or diminish value. To bridge this gap, we stress the importance of assessing the value AI advice brings to real-world contexts when designing and evaluating AI advisors. Building on this perspective, we characterize key pillars -- pathways through which AI advice impacts value -- and develop a framework that incorporates these pillars to create reliable, personalized, and value-adding advisors. Our results highlight the need for value-driven development of AI advisors that advise selectively, are tailored to experts' unique behaviors, and are optimized for context-specific trade-offs between decision improvements and advising costs. They also reveal how the lack of inclusion of these pillars in the design of AI advising systems may be contributing to the failures observed in practical applications.

AI助手决策支持个性化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。