让智能体学会选对思考方式,避免错误推理链蔓延。
Universe Routing: Why Self-Evolving Agents Need Epistemic Control
- 用专用路由机制区分不同认知框架,拒绝混合使用不兼容方法。
- 硬路由比软门控快7倍,且准确率相当,因不兼容框架无法平均。
- 新领域学习时零遗忘,优于传统正则化方法75个百分点。
当前持续学习智能体的关键缺陷并非知识不足,而是无法决定如何推理。当面对‘这枚硬币是否公平?’时,智能体必须判断应使用频率学派假设检验还是贝叶斯后验推断——二者在认识论上不兼容。混合使用会导致结构性错误,并在决策链中传播。我们将其形式化为‘宇宙路由问题’:在调用专用求解器前,将问题分类到互斥的认知空间。关键发现挑战传统认知:(1)硬路由至异构求解器在匹配软门控(MoE)准确率的同时,速度提升7倍,因不兼容框架无法有意义地平均;(2)一个465M参数的路由模块相比关键词匹配基线,泛化误差缩小2.3倍,表明其具备语义而非表面匹配能力;(3)扩展至新认知空间时,基于回放的持续学习实现零遗忘,性能超越EWC达75个百分点,表明模块化认知架构比正则化方法更适配终身学习。这些结果指向一个更广泛的架构原则:可靠自演化智能体或需显式的认知控制层来管理推理框架选择。
原文摘要 · Abstract (English)
A critical failure mode of current lifelong agents is not lack of knowledge, but the inability to decide how to reason. When an agent encounters "Is this coin fair?" it must recognize whether to invoke frequentist hypothesis testing or Bayesian posterior inference - frameworks that are epistemologically incompatible. Mixing them produces not minor errors, but structural failures that propagate across decision chains. We formalize this as the universe routing problem: classifying questions into mutually exclusive belief spaces before invoking specialized solvers. Our key findings challenge conventional assumptions: (1) hard routing to heterogeneous solvers matches soft MoE accuracy while being 7x faster because epistemically incompatible frameworks cannot be meaningfully averaged; (2) a 465M-parameter router achieves a 2.3x smaller generalization gap than keyword-matching baselines, indicating semantic rather than surface-level reasoning; (3) when expanding to new belief spaces, rehearsal-based continual learning achieves zero forgetting, outperforming EWC by 75 percentage points, suggesting that modular epistemic architectures are fundamentally more amenable to lifelong learning than regularization-based approaches. These results point toward a broader architectural principle: reliable self-evolving agents may require an explicit epistemic control layer that governs reasoning framework selection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。