arXiv:2608.25500cs.AIcs.CL2026-08

通过因果反事实校准技能图谱边权重,提升大模型任务中技能检索的准确性和效率。

CaSKG: Counterfactual-Causal Skill Graphs for Scalable Agent Skill Retrieval

论文配图:CaSKG: Counterfactual-Causal Skill Graphs for Scalable Agent Skill Retrieval
图 1 · 摘自论文原文
  • 构建带置信度校准的技能图谱,融合多源证据并用反事实探针优化关系
  • 在六种模型上实现12个组合全部最优,科学世界得分提升7.88点,成功率达86.79%
  • 适合需要高效复用复杂流程知识的大模型任务系统开发者

可复用的技能库使大语言模型代理能在不同任务间共享过程知识,但同时也将记忆访问转化为复杂的检索难题。全库提示虽覆盖全面却消耗大量上下文,向量检索虽紧凑但忽略技能间关联,图结构检索仅在边关系可靠时才能恢复流程上下文。本文提出CaSKG框架,先基于语义、词汇、输入输出及结构证据构建高召回率有向候选图,并通过修复证据与可选大模型判断进一步优化得分;再施加方向性文本反事实探针(删除、替换、重排技能对),结合贝叶斯平滑聚合证据,发布经状态过滤的加权图以支持任务条件扩展。该图离线构建,不改变下游代理策略或任务接口。在六种大模型、ALFWorld ID-140和ScienceWorld U211上的实验表明,所有十二组组合均达到最高任务得分,相对Graph-of-Skills(GoS),科学世界六模型平均分从72.62升至80.50,ALFWorld成功率从80.01%提升至86.79%,且两基准下平均环境步数减少。定性与消融分析显示,校准后的边能更好保留前置条件、状态变更动作、验证流程和最终完成步骤。结果表明,边置信度校准是实现大规模、可执行技能检索的有效路径。

原文摘要 · Abstract (English)

Reusable skill libraries allow large language model (LLM) agents to reuse procedural knowledge across tasks, but they also turn memory access into a challenging retrieval problem. Full-library prompting preserves coverage at high context cost, vector retrieval returns compact neighborhoods but treats skills as independent text, and graph-based retrieval can recover workflow context only when the edges that carry relevance are reliable. We propose CaSKG, a counterfactual-causal skill graph framework that calibrates procedural relations before retrieval. CaSKG first builds a high-recall directed candidate graph from semantic, lexical, input/output, and structural evidence, with repair evidence and an optional LLM judge further refining candidate scores. It then applies direction-conditioned textual counterfactual probes that remove, substitute, and reorder skill pairs, aggregates the evidence with Bayesian smoothing, and publishes a state-filtered weighted graph for task-conditioned expansion. The graph is constructed offline and used without changing the downstream agent policy or task interface. Across six LLM backbones on ALFWorld ID-140 and ScienceWorld U211, CaSKG achieves the highest task score in all twelve combinations of model and benchmark. Relative to Graph-of-Skills (GoS), it improves the six-model macro-average ScienceWorld score from 72.62 to 80.50 and ALFWorld success from 80.01\% to 86.79\%, while reducing mean environment steps on both benchmarks. Qualitative and ablation analyses further show that calibrated edges help retrieval preserve prerequisites, state-changing actions, verification routines, and final completion steps. These results position edge-confidence calibration as an effective route to compact and executable skill retrieval at scale\footnote{Code is available at: https://github.com/ZhiyuanLi218/Caskg }.

技能图谱大模型检索优化因果推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。