arXiv:2601.20556cs.LGcs.AI2026-01中稿 · AISTATS 2026

无需标签数据,用能量模型融合多个预测结果,提升集成学习效果。

Unsupervised Ensemble Learning Through Deep Energy-based Models

  • 基于能量模型构建元学习器,仅使用各学习器的输出进行融合。
  • 在混合专家等复杂场景中表现优于传统方法,无需额外信息。
  • 适用于数据稀缺或隐私敏感场景,理论上有条件独立性保障。

无监督集成学习旨在不依赖真实标签或额外数据的情况下融合多个学习器的预测结果。该范式在无法评估单个分类器性能或理解其优势时尤为重要。本文提出一种基于深度能量模型的新方法,仅利用各学习器的预测输出构建高精度元学习器,具备捕捉它们之间复杂依赖结构的能力。该方法无需标签数据、学习器特征或问题特定信息,并在学习器条件独立时具有理论保证。实验覆盖标准集成数据集和专为测试多源知识融合而设计的定制数据集,在多种集成场景中均表现出色,尤其在混合专家设置下显著优于基线。结果表明,无监督集成学习有望在数据稀疏或隐私敏感环境中充分挖掘集体智能潜力。

原文摘要 · Abstract (English)

Unsupervised ensemble learning emerged to address the challenge of combining multiple learners' predictions without access to ground truth labels or additional data. This paradigm is crucial in scenarios where evaluating individual classifier performance or understanding their strengths is challenging due to limited information. We propose a novel deep energy-based method for constructing an accurate meta-learner using only the predictions of individual learners, potentially capable of capturing complex dependence structures between them. Our approach requires no labeled data, learner features, or problem-specific information, and has theoretical guarantees for when learners are conditionally independent. We demonstrate superior performance across diverse ensemble scenarios, including challenging mixture of experts settings. Our experiments span standard ensemble datasets and curated datasets designed to test how the model fuses expertise from multiple sources. These results highlight the potential of unsupervised ensemble learning to harness collective intelligence, especially in data-scarce or privacy-sensitive environments.

集成学习能量模型无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。