让大模型自我总结经验规则,提升复杂任务表现
OmniReflect: Discovering Transferable Constitutions for LLM agents via Neuro-Symbolic Reflections
- 通过神经符号反思构建可迁移的行动准则
- 自持模式下任务成功率提升超10%,最高达23.8%
- 适用于需要长期学习与高效适应的智能体场景
提升大语言模型智能体在复杂任务中的表现,传统方法多依赖微调与迭代自我修正,但缺乏可迁移的学习机制且在动态环境中效率低下。本文提出OmniReflect,一种分层反射驱动框架,通过任务经验提炼出紧凑的行动宪法(即指导原则),以增强智能体的有效性与效率。该框架支持两种模式:自持模式下,单个智能体在执行任务时周期性自我归纳反思;协作模式下,由元顾问从少量校准数据中推导出宪法,指导另一智能体。采用神经、符号及神经符号技术融合构建宪法原则,在上下文适应性与计算效率间取得平衡。实验结果表明,跨模型平均表现显著提升:自持模式下,ALFWorld任务成功率提升+10.3%,BabyAI提升+23.8%,PDDL提升+8.3%;协作模式中,轻量级Qwen3-4B ReAct智能体超越所有Reflexion基线,在BabyAI上表现最优。结果验证了OmniReflect在不同环境与模型架构下的鲁棒性与有效性。
原文摘要 · Abstract (English)
Efforts to improve Large Language Model (LLM) agent performance on complex tasks have largely focused on fine-tuning and iterative self-correction. However, these approaches often lack generalizable mechanisms for longterm learning and remain inefficient in dynamic environments. We introduce OmniReflect, a hierarchical, reflection-driven framework that constructs a constitution, a compact set of guiding principles distilled from task experiences, to enhance the effectiveness and efficiency of an LLM agent. OmniReflect operates in two modes: Self-sustaining, where a single agent periodically curates its own reflections during task execution, and Co-operative, where a Meta-advisor derives a constitution from a small calibration set to guide another agent. To construct these constitutional principles, we employ Neural, Symbolic, and NeuroSymbolic techniques, offering a balance between contextual adaptability and computational efficiency. Empirical results averaged across models show major improvements in task success, with absolute gains of +10.3% on ALFWorld, +23.8% on BabyAI, and +8.3% on PDDL in the Self-sustaining mode. Similar gains are seen in the Co-operative mode, where a lightweight Qwen3-4B ReAct agent outperforms all Reflexion baselines on BabyAI. These findings highlight the robustness and effectiveness of OmniReflect across environments and backbones.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。