arXiv:2412.17727cs.CL2024-12EMNLP被引 29

用思维链动态更新大模型知识,无需重训即可跨任务通用

Knowledge Editing through Chain-of-Thought

  • 通过生成并迭代优化思维链实现知识编辑
  • 在多语言多任务基准上达到当前最优效果
  • 适合需要持续更新知识的智能系统开发者

知识编辑是一种无需从头训练即可更新大语言模型世界知识的技术。现有基于上下文的知识编辑方法多针对特定任务,依赖少量示例提示进行任务分解,泛化能力差且不稳定。为此,我们提出EditCoT框架,通过生成输入的思维链(CoT)并基于新知识迭代优化该过程,实现无需重训即可在多种任务中高效更新模型知识。我们在涵盖多语言和多任务的多个基准上评估了该方法,结果表明其在性能、泛化性与稳定性方面均优于现有方法,显著推进了知识更新领域的发展。代码与数据已公开于:https://github.com/bebr2/EditCoT。

原文摘要 · Abstract (English)

Knowledge Editing is a technique that updates large language models (LLMs) with new information to maintain their world knowledge. This approach avoids the need to rebuild the model from scratch, thereby addressing the high costs associated with frequent retraining. Among these, the in-context editing paradigm stands out for its effectiveness in integrating new knowledge while preserving the model's original capabilities. Despite its potential, existing in-context knowledge editing methods are often task-specific, focusing primarily on multi-hop QA tasks using structured knowledge triples. Moreover, their reliance on few-shot prompting for task decomposition makes them unstable and less effective in generalizing across diverse tasks. In response to these limitations, we propose EditCoT, a novel knowledge editing framework that flexibly and efficiently updates LLMs across various tasks without retraining. EditCoT works by generating a chain-of-thought (CoT) for a given input and then iteratively refining this CoT process using a CoT editor based on updated knowledge. We evaluate EditCoT across a diverse range of benchmarks, covering multiple languages and tasks. The results demonstrate that our approach achieves state-of-the-art performance while offering superior generalization, effectiveness, and stability compared to existing methods, marking a significant advancement in the field of knowledge updating. The code and data of EditCoT are available at: https://github.com/bebr2/EditCoT .

知识编辑思维链LLM零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。