DRAE让机器人持续学习不遗忘,动态调用专家模型并结合外部知识。
DRAE: Dynamic Retrieval-Augmented Expert Networks for Lifelong Learning and Task Adaptation in Robotics
- 通过稀疏门控机制动态分配专家模型,结合参数化检索增强学习。
- 在动态任务中平均成功率82.5%,比传统MoE高8.3个百分点。
- 适合需要长期适应与记忆保留的机器人系统研发人员使用。
我们提出动态检索增强专家网络(DRAE),解决机器人终身学习中的灾难性遗忘与任务适应难题。该架构融合专家混合模型(MoE)的动态路由、检索增强生成(RAG)的知识增强能力,引入新型分层强化学习框架,由ReflexNet执行底层任务、SchemaPlanner进行符号推理、HyperOptima建模长期上下文,协同通过RSHO系统实现。DRAE采用稀疏门控机制动态路由专家模型,结合参数化检索(P-RAG)增强学习过程。实验表明,DRAE在一系列动态机器人操作任务中平均成功率达82.5%,显著优于传统MoE模型的74.2%。同时,其遗忘率极低,在缓解灾难性遗忘方面超越现有先进方法,验证了该方案在机器人领域实现灵活、可扩展、高效终身学习的有效性。
原文摘要 · Abstract (English)
We introduce Dynamic Retrieval-Augmented Expert Networks (DRAE), a groundbreaking architecture that addresses the challenges of lifelong learning, catastrophic forgetting, and task adaptation by combining the dynamic routing capabilities of Mixture-of-Experts (MoE); leveraging the knowledge-enhancement power of Retrieval-Augmented Generation (RAG); incorporating a novel hierarchical reinforcement learning (RL) framework; and coordinating through ReflexNet-SchemaPlanner-HyperOptima (RSHO).DRAE dynamically routes expert models via a sparse MoE gating mechanism, enabling efficient resource allocation while leveraging external knowledge through parametric retrieval (P-RAG) to augment the learning process. We propose a new RL framework with ReflexNet for low-level task execution, SchemaPlanner for symbolic reasoning, and HyperOptima for long-term context modeling, ensuring continuous adaptation and memory retention. Experimental results show that DRAE significantly outperforms baseline approaches in long-term task retention and knowledge reuse, achieving an average task success rate of 82.5% across a set of dynamic robotic manipulation tasks, compared to 74.2% for traditional MoE models. Furthermore, DRAE maintains an extremely low forgetting rate, outperforming state-of-the-art methods in catastrophic forgetting mitigation. These results demonstrate the effectiveness of our approach in enabling flexible, scalable, and efficient lifelong learning for robotics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。