arXiv:2512.08366cs.AI2025-12被引 1

不用演示也能智能决策,让大模型像人一样自我反思调整策略。

Reflecting with Two Voices: A Co-Adaptive Dual-Strategy Framework for LLM-Based Agent Decision Making

  • 用两种互补策略协同思考:全局规划+局部执行,通过轻量反思机制动态调整。
  • 在真实网页和模拟家居任务中表现顶尖,无需演示或微调,还大幅降低每步耗 token 数。
  • 适合追求高效、通用、可解释的AI代理开发,尤其适合资源受限场景。

大型语言模型(LLM)代理通常依赖外部示范或检索增强规划,导致脆弱、泛化差且计算开销高。受人类问题解决启发,我们提出 DuSAR(带反思的双策略代理)——一种无需示范的框架,使单个冻结的 LLM 能通过两种互补策略进行协同自适应推理:高层整体规划与上下文感知的局部策略。二者通过轻量级反思机制交互,代理持续通过策略适配度评分评估进展,在卡住时动态修正全局计划,或在有意义进展时优化计划,模仿人类元认知行为。在模拟家庭环境(ALFWorld)和真实网络环境(Mind2Web)中,DuSAR 仅使用开源 LLM 即达到当前最优性能,显著优于所有先前方法,且无需任何示范或微调。尤为突出的是,其每步 token 消耗大幅减少,同时保持高任务成功率。消融实验确认双策略协同必要性。此外,可选地融合专家示范进一步提升性能,凸显 DuSAR 的灵活性与对外部知识的兼容性。

原文摘要 · Abstract (English)

Large language model (LLM) agents often rely on external demonstrations or retrieval-augmented planning, leading to brittleness, poor generalization, and high computational overhead. Inspired by human problem-solving, we propose DuSAR (Dual-Strategy Agent with Reflecting) -- a demonstration-free framework that enables a single frozen LLM to perform co-adaptive reasoning via two complementary strategies: a high-level holistic plan and a context-grounded local policy. These strategies interact through a lightweight reflection mechanism, where the agent continuously assesses progress via a Strategy Fitness Score and dynamically revises its global plan when stuck or refines it upon meaningful advancement, mimicking human metacognitive behavior. On both simulated household (ALFWorld) and real-world web (Mind2Web) environments, DuSAR achieves state-of-the-art performance using only open-source LLMs, substantially outperforming all prior methods without any demonstrations or fine-tuning. Remarkably, it also reduces per-step token consumption by a large margin while maintaining strong task success. Ablation studies confirm the necessity of dual-strategy coordination. Moreover, optional integration of expert demonstrations further boosts performance, highlighting DuSAR's flexibility and compatibility with external knowledge.

大模型代理双策略自我反思零样本决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。