让大模型生成动作的智能体更可靠,通过分层纠错图自动识别并修复错误。
A Hierarchical Error-Corrective Graph Framework for Autonomous Agents with LLM-Based Action Generation
- 用多维指标筛选高质量策略,减少错误动作传递风险。
- 将任务失败细分为10类错误,精准定位根因并指导修复。
- 构建因果图检索历史经验,加速复杂任务中的策略适应。
我们提出一种分层纠错图框架(HECG),用于基于大语言模型生成动作的自主智能体。核心创新包括:(1) 多维可迁移策略(MDTS):融合任务质量(Q)、置信度/成本(C)、奖励(R)及大模型语义评分(LLM-Score),实现量化表现与语义上下文的多维度对齐,更精准筛选高质量候选策略,有效降低负向迁移风险;(2) 错误矩阵分类(EMC):将任务失败分解为10类错误,如策略错误(Strategy Error)和脚本解析错误(Script-Parsing-Error),并按严重性、典型动作、错误描述和可恢复性分类,实现失败原因的结构化归因,为后续纠错与策略优化提供明确指引,而非依赖总体成功率或单一指标;(3) 因果-上下文图检索(CCGR):构建包含历史状态、动作与事件序列的图结构,节点存储执行动作、下一步动作、执行状态、可迁移策略等信息,边表示转移的前置条件等因果关系,通过识别与当前任务上下文最相关的子图,超越向量相似性,捕捉深层结构关系,使智能体能充分调用上下文信息,加速策略适应,在复杂多步任务中提升执行可靠性。
原文摘要 · Abstract (English)
We propose a Hierarchical Error-Corrective Graph FrameworkforAutonomousAgentswithLLM-BasedActionGeneration(HECG),whichincorporates three core innovations: (1) Multi-Dimensional Transferable Strategy (MDTS): by integrating task quality metrics (Q), confidence/cost metrics (C), reward metrics (R), and LLM-based semantic reasoning scores (LLM-Score), MDTS achieves multi-dimensional alignment between quantitative performance and semantic context, enabling more precise selection of high-quality candidate strate gies and effectively reducing the risk of negative transfer. (2) Error Matrix Classification (EMC): unlike simple confusion matrices or overall performance metrics, EMC provides structured attribution of task failures by categorizing errors into ten types, such as Strategy Errors (Strategy Whe) and Script Parsing Errors (Script-Parsing-Error), and decomposing them according to severity, typical actions, error descriptions, and recoverability. This allows precise analysis of the root causes of task failures, offering clear guidance for subsequent error correction and strategy optimization rather than relying solely on overall success rates or single performance metrics. (3) Causal-Context Graph Retrieval (CCGR): to enhance agent retrieval capabilities in dynamic task environments, we construct graphs from historical states, actions, and event sequences, where nodes store executed actions, next-step actions, execution states, transferable strategies, and other relevant information, and edges represent causal dependencies such as preconditions for transitions between nodes. CCGR identifies subgraphs most relevant to the current task context, effectively capturing structural relationships beyond vector similarity, allowing agents to fully leverage contextual information, accelerate strategy adaptation, and improve execution reliability in complex, multi-step tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。