arXiv:2509.24312stat.MLcs.LG2025-09

融合多种表示学习方法,提升下游任务性能。

PEARL: Performance-Enhanced Aggregated Representation Learning

  • 通过加权聚合多模型表示,提升表征能力
  • 实验显示在多个任务上优于基线方法
  • 适合需要高精度表征的复杂场景

表示学习是现代机器学习中的关键技术,使模型能够从复杂数据中识别有意义的模式。然而,不同方法往往提取数据的不同方面,仅依赖单一方法可能遗漏对下游任务重要的信息。本文提出一种性能增强的聚合表示学习方法,通过结合多种表示学习策略,提升下游任务表现。该框架通用且灵活,可适配多种常用损失函数。为保证计算效率,采用代理损失函数实现权重估计。理论上证明,该方法在渐近意义上达到下游任务最优性能,即预测器风险趋近理论最小值;同时证明其渐近分配非零权重给正确指定的模型。在多样化任务上的实验表明,该方法持续优于基线方法,验证了其在真实机器学习场景中的有效性与广泛适用性。

原文摘要 · Abstract (English)

Representation learning is a key technique in modern machine learning that enables models to identify meaningful patterns in complex data. However, different methods tend to extract distinct aspects of the data, and relying on a single approach may overlook important insights relevant to downstream tasks. This paper proposes a performance-enhanced aggregated representation learning method, which combines multiple representation learning approaches to improve the performance of downstream tasks. The framework is designed to be general and flexible, accommodating a wide range of loss functions commonly used in machine learning models. To ensure computational efficiency, we use surrogate loss functions to facilitate practical weight estimation. Theoretically, we prove that our method asymptotically achieves optimal performance in downstream tasks, meaning that the risk of our predictor is asymptotically equivalent to the theoretical minimum. Additionally, we derive that our method asymptotically assigns nonzero weights to correctly specified models. We evaluate our method on diverse tasks by comparing it with advanced machine learning models. The experimental results demonstrate that our method consistently outperforms baseline methods, showing its effectiveness and broad applicability in real-world machine learning scenarios.

表示学习多模型融合性能优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。