让AI智能体像人一样懂得何时用知识,何时不用。
Agentic Knowledgeable Self-awareness
- 用特殊标记捕捉智能体自探索轨迹,构建训练数据
- 两阶段训练使智能体能按需调用知识,减少资源浪费
- 无需大量外部知识也能超越主流基线,适合高效部署
大语言模型在各类智能体规划任务中表现优异,但传统方法采用‘泛滥式’注入黄金轨迹、外部反馈和领域知识,忽视了人类决策中的情境自知能力——即动态评估需求并策略性使用资源。为此,我们提出智能体知识自知性(KnowSelf),一种数据驱动的新范式,使基于LLM的智能体能自主调控知识使用。具体地,设计启发式情境判断标准,在智能体自探索轨迹中标记特殊令牌以收集训练数据。通过两阶段训练,智能体可生成特定特殊令牌切换不同情境,实现最优规划且成本最低。实验表明,KnowSelf在多个任务与模型上均优于强基线,且极少依赖外部知识。代码已开源:https://github.com/zjunlp/KnowSelf。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have achieved considerable performance across various agentic planning tasks. However, traditional agent planning approaches adopt a "flood irrigation" methodology that indiscriminately injects gold trajectories, external feedback, and domain knowledge into agent models. This practice overlooks the fundamental human cognitive principle of situational self-awareness during decision-making-the ability to dynamically assess situational demands and strategically employ resources during decision-making. We propose agentic knowledgeable self-awareness to address this gap, a novel paradigm enabling LLM-based agents to autonomously regulate knowledge utilization. Specifically, we propose KnowSelf, a data-centric approach that applies agents with knowledgeable self-awareness like humans. Concretely, we devise a heuristic situation judgement criterion to mark special tokens on the agent's self-explored trajectories for collecting training data. Through a two-stage training process, the agent model can switch between different situations by generating specific special tokens, achieving optimal planning effects with minimal costs. Our experiments demonstrate that KnowSelf can outperform various strong baselines on different tasks and models with minimal use of external knowledge. Code is available at https://github.com/zjunlp/KnowSelf.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。