arXiv:2411.06746cs.LG2024-11被引 1

让机器像人一样灵活调整网络结构,提升多任务学习效率。

Neuromodulated Meta-Learning

  • 引入可变网络结构机制,动态调整模型以适应不同任务。
  • 在多个任务上实现更高性能和更快学习速度,超越固定结构模型。
  • 适合研究高效元学习、神经形态计算的学者与工程师。

人类能高效适应不同环境,依赖于生物神经系统(BNS)在不同任务中激活不同脑区。元学习虽能训练机器处理多任务,但依赖固定网络结构,灵活性不足。本文通过理论与实证分析发现,模型性能与结构密切相关,不存在跨任务通用最优结构。这揭示了灵活网络结构(FNS)在元学习中的关键作用——为每项任务生成最优结构,从而最大化性能与学习效率。基于此,我们提出定义、度量并建模FNS:首先确立其应具备简约性、可塑性和敏感性;随后设计三类量化指标,形成具有理论支撑的“结构约束”。在此基础上,提出神经调节元学习(NeuronML),通过双层优化同时更新权重与结构。大量理论与实验验证表明,NeuronML在多种任务上表现优异。代码已公开于https://github.com/WangJingyao07/NeuronML。

原文摘要 · Abstract (English)

Humans excel at adapting perceptions and actions to diverse environments, enabling efficient interaction with the external world. This adaptive capability relies on the biological nervous system (BNS), which activates different brain regions for distinct tasks. Meta-learning similarly trains machines to handle multiple tasks but relies on a fixed network structure, not as flexible as BNS. To investigate the role of flexible network structure (FNS) in meta-learning, we conduct extensive empirical and theoretical analyses, finding that model performance is tied to structure, with no universally optimal pattern across tasks. This reveals the crucial role of FNS in meta-learning, ensuring meta-learning to generate the optimal structure for each task, thereby maximizing the performance and learning efficiency of meta-learning. Motivated by this insight, we propose to define, measure, and model FNS in meta-learning. First, we define that an effective FNS should possess frugality, plasticity, and sensitivity. Then, to quantify FNS in practice, we present three measurements for these properties, collectively forming the \emph{structure constraint} with theoretical supports. Building on this, we finally propose Neuromodulated Meta-Learning (NeuronML) to model FNS in meta-learning. It utilizes bi-level optimization to update both weights and structure with the structure constraint. Extensive theoretical and empirical evaluations demonstrate the effectiveness of NeuronML on various tasks. Code is publicly available at \href{https://github.com/WangJingyao07/NeuronML}{https://github.com/WangJingyao07/NeuronML}.

元学习灵活结构神经调节

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。