分离任务因素的元学习框架,提升模型泛化与鲁棒性。
Disentangled Multi-Context Meta-Learning: Unlocking robust and Generalized Task Learning
- 将任务因素分解到独立上下文向量,解耦混合特征。
- 在正弦回归和四足机器人任务中,外分布泛化性能优于基线。
- 仅用20秒真实数据即可实现复杂地形的仿真到现实迁移。
在元学习及其下游任务中,许多方法依赖于对任务变化的隐式适应,导致多个因素混杂在同一表征中,难以解释性能驱动因素并阻碍泛化。本文提出一种解耦多上下文元学习框架,显式将每个任务因素分配至独立上下文向量。通过解耦变化因素,该方法通过更深入的任务理解提升鲁棒性,并通过共享具有共同因素的任务上下文向量增强泛化能力。我们在两个领域评估该方法:首先,在正弦回归任务中,模型在外分布任务上表现超越基线,并能通过共享幅度或相位偏移对应的上下文向量泛化至未见正弦函数;其次,在四足机器人运动任务中,我们从机器人动力学模型中解耦出机器人特性和地形特性。将解耦后的上下文向量迁移至强化学习策略中,使策略在分布外条件下表现出更强鲁棒性,优于依赖单一统一上下文的基线。此外,通过有效共享上下文,模型仅需20秒平坦地形真实数据,即可成功实现复杂地形的仿真到现实策略迁移,而单任务适应无法达成此效果。
原文摘要 · Abstract (English)
In meta-learning and its downstream tasks, many methods rely on implicit adaptation to task variations, where multiple factors are mixed together in a single entangled representation. This makes it difficult to interpret which factors drive performance and can hinder generalization. In this work, we introduce a disentangled multi-context meta-learning framework that explicitly assigns each task factor to a distinct context vector. By decoupling these variations, our approach improves robustness through deeper task understanding and enhances generalization by enabling context vector sharing across tasks with shared factors. We evaluate our approach in two domains. First, on a sinusoidal regression task, our model outperforms baselines on out-of-distribution tasks and generalizes to unseen sine functions by sharing context vectors associated with shared amplitudes or phase shifts. Second, in a quadruped robot locomotion task, we disentangle the robot-specific properties and the characteristics of the terrain in the robot dynamics model. By transferring disentangled context vectors acquired from the dynamics model into reinforcement learning, the resulting policy achieves improved robustness under out-of-distribution conditions, surpassing the baselines that rely on a single unified context. Furthermore, by effectively sharing context, our model enables successful sim-to-real policy transfer to challenging terrains with out-of-distribution robot-specific properties, using just 20 seconds of real data from flat terrain, a result not achievable with single-task adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。