arXiv:2510.26706cs.LGstat.ML2025-10被引 15

让机器学习模型在训练时智能选择专家,省钱不降准。

Budgeted Multiple-Expert Deferral

  • 训练时只选部分专家查询,降低计算成本
  • 实测节省大量专家调用,准确率几乎不变
  • 适合资源紧张但要高精度的部署场景

让模型在不确定时将预测任务委派给昂贵专家,是提升机器学习系统准确性和效率的有效策略。然而,标准训练方法通常需对每个训练样本调用所有专家,当专家查询成本高昂时,这会变得难以承受,违背了减少不必要的专家使用这一初衷。为此,我们提出预算化委派框架,在训练阶段最小化专家查询成本的同时仍能训练出高效的委派算法。针对两阶段和单阶段多专家委派设置,我们设计了新算法,仅对每个训练样本选择性地查询部分专家。尽管受主动学习启发,但本问题本质不同:标签已知,核心挑战在于决定查询哪些专家以平衡成本与性能。我们为两个算法建立了理论保证,包括泛化界和标签复杂度分析。多个领域的实验证明,我们的算法显著降低训练成本且不牺牲预测准确率,验证了预算感知委派算法的实际价值。

原文摘要 · Abstract (English)

Learning to defer uncertain predictions to costly experts offers a powerful strategy for improving the accuracy and efficiency of machine learning systems. However, standard training procedures for deferral algorithms typically require querying all experts for every training instance, an approach that becomes prohibitively expensive when expert queries incur significant computational or resource costs. This undermines the core goal of deferral: to limit unnecessary expert usage. To overcome this challenge, we introduce the budgeted deferral framework, which aims to train effective deferral algorithms while minimizing expert query costs during training. We propose new algorithms for both two-stage and single-stage multiple-expert deferral settings that selectively query only a subset of experts per training example. While inspired by active learning, our setting is fundamentally different: labels are already known, and the core challenge is to decide which experts to query in order to balance cost and predictive performance. We establish theoretical guarantees for both of our algorithms, including generalization bounds and label complexity analyses. Empirical results across several domains show that our algorithms substantially reduce training costs without sacrificing prediction accuracy, demonstrating the practical value of our budget-aware deferral algorithms.

模型委派预算优化多专家系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。