Macaron-V1让模型部署后仍能持续学习,通过自我改进和专家适配器协作提升能力。
Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA

- 采用版本化模型与适配器递归自进化,实现持续学习
- 用LoRA组合专家模块,按用户需求动态选择适配器
- 适合需要长期迭代的智能代理场景,如个人助手
Macaron-V1 是一个面向经验智能的开放代理-模型家族,可在真实环境中学习并部署后持续进化。系统围绕两个目标构建:通过递归优化版本化的模型-适配器对实现适应性,将前一配置的经验在外部契约下评估,并用于生成后续版本;通过混合式LoRA(MoL)架构实现协作,冻结基础模型,组合专用LoRA适配器,并在每个用户回合选择一个适配器。旗舰模型 Macaron-V1-Venti(748B)融合了744B的GLM-5.2基础模型与四个针对对话、代理、编程和GenUI的LoRA;基于Qwen3.6-35B的Macaron-V1-Tall(50B)采用相同设计,支持本地部署。该系统整合了架构、算法与基础设施:MoL支持可扩展的持续学习;算法结合模型-适配器协同设计与自循环改进,包含原生GenUI适配器、有状态动作底座、版本化适配器上下文协议及智能体强化学习框架MindForge;基础设施包括后训练平台MinT、长上下文强化学习方法LongStraw,以及稀疏MoE与DSA基础模型的稳定性技术。在个人智能、GenUI和通用能力基准上评估,结果验证了当前系统有效性,但持续学习与集体智能带来的累积收益仍是开放问题。
原文摘要 · Abstract (English)
Macaron-V1 is an open agent-model family for experiential intelligence: learning from experience in real environments and continuing to learn after deployment. It is organized around two system goals. Adaptation is pursued through recursive improvement of versioned model-harness pairs, where experience from one configuration is evaluated under an external contract and used to construct its successor. Collaboration is pursued via the Mixture-of-LoRA (MoL) architecture that freezes a base model, composes specialist LoRA adapters, and selects one LoRA per user turn. The flagship Macaron-V1-Venti (748B) combines a 744B GLM-5.2 base with four LoRAs for chat, agent, coding, and GenUI; the Qwen3.6-35B-based Macaron-V1-Tall (50B) uses the same design for local deployment. This report presents Macaron-V1 as a co-designed system spanning architecture, algorithms, and infrastructure. The MoL architecture supports continual learning through extensible LoRA specialists. The algorithm combines Model-Harness Co-design and recursive self-improvement loop, including the UI4A component-native GenUI harness, a stateful action substrate, versioned Harness Context Protocol contract, and the agentic RL framework MindForge. The supporting infrastructure includes the post-training platform MinT, the long-context RL method LongStraw, and stability techniques for sparse MoE and DSA base models. We evaluate Macaron-V1 on Personal Intelligence, GenUI, and general capability benchmarks against frontier baselines. Our results validate the current system, while compounding gains from continual learning and collective intelligence remain open questions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。