小模型也能精准更新常识知识，让助手更懂你的生活细节。
CaseEdit: Enhancing Localized Commonsense Reasoning via Null-Space Constrained Knowledge Editing in Small Parameter Language Models
- 用多阶段生成法构建个性化常识编辑数据集
- 零空间投影法在小模型上实现无干扰知识更新
- 适合开发轻量级、个性化的智能助手
大语言模型在事实回忆和通用推理上表现良好，但在适应用户特定的常识知识方面存在挑战，尤其在参数量小、追求计算效率的场景下更为明显。本文提出CaseEdit，一个基于ATOMIC20/20常识图谱的新数据集与生成流程，用于评估小规模语言模型中的局部化、个性化常识知识编辑。通过多阶段推理生成家庭物品的典型与非典型情境编辑，并设计四维度评估问题：可靠性、泛化性、局部性和可移植性。在LLaMA 3.2 3B模型上测试现有编辑方法，发现采用零空间投影的AlphaEdit方法始终优于其他方法，即使在可扩展性测试中也表现出最小的涟漪效应。结果表明，结合CaseEdit与高效编辑技术如AlphaEdit，可使小模型有效内化高质量、上下文敏感的常识知识，为轻量化个性化助手提供可行路径。
原文摘要 · Abstract (English)
Large language models (LLMs) exhibit strong performance on factual recall and general reasoning but struggle to adapt to user-specific, commonsense knowledge, a challenge particularly acute in small-parameter settings where computational efficiency is prioritized. We introduce CaseEdit, a new dataset and generation pipeline for evaluating localized, personalized commonsense knowledge editing in small LLMs to address this. Built upon the ATOMIC20/20 commonsense graph, CaseEdit uses a multi-stage inference process to generate both typical and atypical contextual edits for household objects, paired with targeted evaluation questions across four axes: reliability, generalization, locality, and portability. We evaluate established knowledge editing methods using CaseEdit and demonstrate that AlphaEdit, a technique employing null-space projection to minimize interference with unrelated knowledge, consistently outperforms other methods when applied to an LLaMA 3.2 3B model, even in scalability tests, showing minimal ripple effects. Our results indicate that using CaseEdit with effective editing techniques like AlphaEdit allows small models to internalize high-quality, context-sensitive common-sense knowledge, paving the way for lightweight, personalized assistants.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。