让AI学会主动问人,比单纯依赖或拒绝人类更高效
To Ask or Not to Ask: Learning to Require Human Feedback
- AI模型分两部分:基础模型+带专家反馈的增强模型,决定何时询问
- 实验显示,新方法在真实和合成数据上均提升协作效率
- 适合需要高质量人工介入的医疗、金融等高风险场景
在分类任务中构建能辅助人类决策的系统仍是开放挑战。现有主流方法学习去延迟(LtD)将困难样本交给人类专家处理,但将人与机器视为互斥决策者,仅让专家提供预测结果。为解决此问题,我们提出学习提问(LtA)框架,实现对何时以及如何引入专家输入的联合优化。LtA采用双模块架构:标准机器学习模型与基于额外专家反馈训练的增强模型,并设计出形式最优的查询策略。我们给出两种实现方式:分阶段训练的序列法和同步优化的联合法。后者设计了具有可实现一致性保障的代理损失函数。在合成数据和真实专家数据上的实验表明,LtA为高效人机协作提供了更灵活且强大的基础。
原文摘要 · Abstract (English)
Developing decision-support systems that complement human performance in classification tasks remains an open challenge. A popular approach, Learning to Defer (LtD), allows a Machine Learning (ML) model to pass difficult cases to a human expert. However, LtD treats humans and ML models as mutually exclusive decision-makers, restricting the expert contribution to mere predictions. To address this limitation, we propose Learning to Ask (LtA), a new framework that handles both when and how to incorporate expert input in an ML model. LtA is based on a two-part architecture: a standard ML model and an enriched model trained with additional expert human feedback, with a formally optimal strategy for selecting when to query the enriched model. We provide two practical implementations of LtA: a sequential approach, which trains the models in stages, and a joint approach, which optimises them simultaneously. For the latter, we design surrogate losses with realisable-consistency guarantees. Our experiments with synthetic and real expert data demonstrate that LtA provides a more flexible and powerful foundation for effective human-AI collaboration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。