arXiv:2509.21707stat.MLcs.LG2025-09被引 1

安全融合多个不可靠预测,保证不比只用标注数据差

SADA: Safe and Adaptive Aggregation of Multiple Black-Box Predictions in Semi-Supervised Learning

  • 设计自适应聚合机制,动态整合多源黑箱预测
  • 无论预测质量如何,性能至少不低于仅用标注数据
  • 若有任一预测完美匹配真实标签,可加速收敛或达最优效率

半监督学习(SSL)在标注数据稀缺或获取成本高时尤为关键,而大量无标签数据易于获取。随着机器学习广泛应用,通过深度学习、大语言模型和生成式AI等多种模型生成多个预测标签已成可能。本文提出一种新方法,能安全且自适应地聚合多个质量不确定的黑箱预测,适用于推理与预测任务。该方法提供双重保障:(i) 无论预测质量如何,性能始终不低于仅使用标注数据;(ii) 只要任意一个预测与真实标签完全一致(无需识别是哪一个),算法将自适应利用此信息,实现更快收敛或达到半参数效率边界。通过小规模模拟及两个具有不同科学目标的真实数据分析验证了方法有效性。配套提供了易用的R包sada以支持实际应用。

原文摘要 · Abstract (English)

Semi-supervised learning (SSL) arises in practice when labeled data are scarce or expensive to obtain, while large quantities of unlabeled data are readily available. With the growing adoption of machine learning techniques, it has become increasingly feasible to generate multiple predicted labels using a variety of models and algorithms, including deep learning, large language models, and generative AI. In this paper, we propose a novel approach that safely and adaptively aggregates multiple black-box predictions of uncertain quality for both inference and prediction tasks. Our method provides two key guarantees: (i) it never performs worse than using the labeled data alone, regardless of the quality of the predictions; and (ii) if any one of the predictions (without knowing which one) perfectly fits the ground truth, the algorithm adaptively exploits this to achieve either a faster convergence rate or the semiparametric efficiency bound. We demonstrate the effectiveness of the proposed algorithm through small-scale simulations and two real-data analyses with distinct scientific goals. A user-friendly R package, sada, is provided to facilitate practical implementation.

半监督学习预测融合黑箱集成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。