arXiv:2504.09283cs.HCcs.AI2025-04被引 12

让AI帮助用户在大规模意图记忆中更新信息并解决语义冲突。

Semantic Commit: Helping Users Update Intent Specifications for AI Memory at Scale

  • 通过类软件工程的变更分析,实现语义更新时的冲突检测与修复。
  • 12人实验显示半数用户采用先标记后本地修复的分步工作流。
  • 适合开发智能体记忆系统或需持续维护文档的AI工具设计者。

如何随用户意图变化更新AI记忆?本文提出一种基于软件工程中影响分析思想的方法,支持在自然语言数据存储中整合新信息。用户通过“语义提交”将新意图写入项目,AI则协助检测和解决现有意图规范(如游戏设计文档、ChatGPT风格的记忆)中的语义冲突。我们构建了名为SemanticCommit的界面,结合知识图谱增强的RAG管道进行冲突识别,由大模型辅助生成解决方案。在初步基准测试后,开展12人跨被试研究,涵盖游戏设计文档与AI代理记忆两个任务领域。结果显示,尽管提供全局修订功能,仍有半数参与者优先使用先标记冲突、再本地修复的工作流程。研究强调:像Cursor、Windsurf这类智能开发环境应提供影响分析支持,并允许用户独立验证AI检索结果。本工作揭示了意图记忆更新是包含人工反馈与决策的过程。

原文摘要 · Abstract (English)

How do we update AI memory of user intent as intent changes? We consider how an AI interface may assist the integration of new information into a repository of natural language data. Inspired by software engineering concepts like impact analysis, we develop methods and a UI for managing semantic changes with non-local effects, which we call "semantic conflict resolution." The user commits new intent to a project -- makes a "semantic commit" -- and the AI helps the user detect and resolve semantic conflicts within a store of existing information representing their intent (an "intent specification"). We develop an interface, SemanticCommit, to better understand how users resolve conflicts when updating intent specifications such as Cursor Rules and game design documents. A knowledge graph-based RAG pipeline drives conflict detection, while LLMs assist in suggesting resolutions. We evaluate our technique on an initial benchmark. Then, we report a 12 user within-subjects study of SemanticCommit for two task domains -- game design documents, and AI agent memory in the style of ChatGPT memories -- where users integrated new information into an existing list. Half of our participants adopted a workflow of impact analysis, where they would first flag conflicts without AI revisions then resolve conflicts locally, despite having access to a global revision feature. We argue that AI agent interfaces, such as software IDEs like Cursor and Windsurf, should provide affordances for impact analysis and help users validate AI retrieval independently from generation. Our work speaks to how AI agent designers should think about updating memory as a process that involves human feedback and decision-making.

AI记忆语义冲突交互设计大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。