arXiv:2410.18894cs.LG2024-10被引 3

针对任务难易不一的现实场景,提出新元学习方法提升模型泛化能力。

Meta-Learning with Heterogeneous Tasks

  • 基于任务排序设计学习目标,区分不同难度任务
  • 有效避免简单任务主导学习过程,提升整体性能
  • 适合处理真实世界中差异大的多样化任务

元学习能帮助模型在面对多个任务时应对少样本情形。现有方法通常假设所有任务同等重要,但实际应用中任务存在难度差异、训练样本噪声或显著异于多数任务的情况。本文提出一种新元学习方法——基于排序的任务级学习目标(HeTRoM),可有效处理异质任务,防止简单任务主导元学习过程。该方法采用双层优化框架,结合统计指导改进迭代优化效率。实验表明,该方法具有灵活性,能适应多种任务设置,并显著提升元学习器的整体表现。

原文摘要 · Abstract (English)

Meta-learning is a general approach to equip machine learning models with the ability to handle few-shot scenarios when dealing with many tasks. Most existing meta-learning methods work based on the assumption that all tasks are of equal importance. However, real-world applications often present heterogeneous tasks characterized by varying difficulty levels, noise in training samples, or being distinctively different from most other tasks. In this paper, we introduce a novel meta-learning method designed to effectively manage such heterogeneous tasks by employing rank-based task-level learning objectives, Heterogeneous Tasks Robust Meta-learning (HeTRoM). HeTRoM is proficient in handling heterogeneous tasks, and it prevents easy tasks from overwhelming the meta-learner. The approach allows for an efficient iterative optimization algorithm based on bi-level optimization, which is then improved by integrating statistical guidance. Our experimental results demonstrate that our method provides flexibility, enabling users to adapt to diverse task settings and enhancing the meta-learner's overall performance.

元学习异质任务少样本优化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。