让智能助手识别用户请求中的隐性冲突,避免在不合适时盲目执行。
PACE: Towards Surfacing Hidden Conflicts in User Requests

- 基于角色和上下文知识库,判断请求是否因隐藏因素而冲突。
- 新框架PaceMaker在多跳检索与冲突过滤中表现优于现有方法。
- 适合研究对话系统安全性和个性化决策的学者与工程师。
个性化助手不仅应执行用户请求,还需评估请求在当前情境下是否恰当。然而,以往工作主要关注请求执行的准确性,忽视了上下文感知与基于冲突的拒绝机制。现有冲突检测依赖显式因素,但现实场景常涉及需从知识库中检索的隐含因素。为此,我们提出PACE数据集,用于评估模型识别潜在约束(如以自我为中心的知识或事件)的能力,这些约束会使看似合理的请求变得不恰当。PACE将用户请求与明确的人物设定及自我中心知识库事实配对,要求模型整合上下文证据判断请求是否存在冲突。该隐式检索设置使请求与引发冲突的知识之间缺乏直接关联,导致现有模型难以定位相关用户特定信息。为应对这一挑战,我们进一步提出PaceMaker,一种多智能体框架,通过查询重构、多跳图遍历和冲突感知过滤协作,实现上下文关键证据的精准检索。在PACE上的实验评估了证据检索质量与冲突判断准确率,结果表明PaceMaker始终优于现有方法。
原文摘要 · Abstract (English)
Personalized assistants should not only comply with user requests but also assess whether those requests are appropriate given the user's current circumstances. However, prior work has primarily focused on accurately executing requests, overlooking the need for assistants to account for context and engage in conflict-based refusal. Furthermore, while existing work on conflict or safety detection relies on explicitly provided factors, real-world scenarios often involve implicit factors that must be retrieved from a knowledge base (KB). To this end, we introduce Personalized Assistants for Conflict Evaluation (PACE), a dataset for evaluating whether models can identify latent constraints, expressed as egocentric knowledge or events, that render seemingly reasonable user requests inappropriate. PACE pairs user requests grounded in well-defined personas with egocentric KB facts, requiring models to integrate contextual evidence to determine whether a request is conflicting. This implicit retrieval setting hinders the direct association between user requests and conflict-inducing knowledge, making it difficult for existing models to identify relevant user-specific facts. To address this challenge, we further propose PaceMaker, a multi-agent framework in which specialized agents coordinate across query reformulation, multi-hop graph traversal, and conflict-aware filtering to retrieve contextually decisive evidence. Experiments on PACE evaluate both evidence retrieval quality and conflict decision accuracy, showing that PaceMaker consistently outperforms existing approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。