首个统一预测与多实体拒答的一阶段方法,提升决策效率。
One-Stage Top-$k$ Learning-to-Defer: Score-Based Surrogates with Theoretical Guarantees
- 用共享评分模型同时优化预测与多实体拒答决策
- 在CIFAR-10和SVHN上优于单专家拒答,且无需重新训练
- 支持动态调整拒答数量,适合复杂输入的高效决策
我们提出首个一阶段的Top-$k$学习拒答框架,通过一个共享的基于评分的模型,为每个输入选择$ k $个最具成本效益的实体(标签或专家)。现有的一阶段拒答方法仅限于单一专家,而本方法通过单一端到端目标联合优化预测与多实体拒答。我们定义了一个成本敏感损失,并推导出一种不依赖于基数参数$ k $的新型凸代理损失,实现跨不同Top-$k$场景的泛化而无需重训练。该公式在特定情况下可恢复先前基于评分方法的Top-1拒答策略,并在弱假设下证明其贝叶斯一致性和$\mathcal{H}$一致性。我们进一步引入自适应变体Top-$k(x)$,根据输入复杂度动态调整每例所咨询实体数量,以平衡准确率与咨询成本。在CIFAR-10和SVHN上的实验表明,我们的方法严格优于Top-1拒答,而Top-$k(x)$通过个性化分配实现了更优的准确率-成本权衡。
原文摘要 · Abstract (English)
We introduce the first one-stage Top-$k$ Learning-to-Defer framework, which unifies prediction and deferral by learning a shared score-based model that selects the $k$ most cost-effective entities-labels or experts-per input. While existing one-stage L2D methods are limited to deferring to a single expert, our approach jointly optimizes prediction and deferral across multiple entities through a single end-to-end objective. We define a cost-sensitive loss and derive a novel convex surrogate that is independent of the cardinality parameter $k$, enabling generalization across Top-$k$ regimes without retraining. Our formulation recovers the Top-1 deferral policy of prior score-based methods as a special case, and we prove that our surrogate is both Bayes-consistent and $\mathcal{H}$-consistent under mild assumptions. We further introduce an adaptive variant, Top-$k(x)$, which dynamically selects the number of consulted entities per input to balance predictive accuracy and consultation cost. Experiments on CIFAR-10 and SVHN confirm that our one-stage Top-$k$ method strictly outperforms Top-1 deferral, while Top-$k(x)$ achieves superior accuracy-cost trade-offs by tailoring allocations to input complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。