arXiv:2606.20585cs.HCcs.AI2026-06

让智能体学会与用户协作,把模糊意图转为可执行规范。

Turning Intent into Specifications: A Benchmark and an Interactive User-Assistant Agent

论文配图:Turning Intent into Specifications: A Benchmark and an Interactive User-Assistant Agent
图 1 · 摘自论文原文
  • 用结构化设计维度分解用户意图,模拟用户评估选项
  • 在5轮内完成澄清,避免过早编码或过度提问
  • 适合研究人机协作、智能体交互的开发者

当前智能体在执行明确的设计方案时表现优异,但用户意图常模糊,存在多种合理解。本文提出SpecBench基准,评估智能体将用户意图转化为结构化、可执行规范的能力。智能体可访问历史对话,在固定轮次内与用户互动以澄清问题。我们发现现有智能体呈现两种极端行为:要么过早进入编码模式,高估对用户偏好的理解;要么耗尽提问次数,对每个模糊点都追问。为此,我们提出用户助手代理Buddy,其工作流受经典形态分析启发,将用户意图分解为设计维度与候选选择,通过模拟用户评估选项,再与真实用户协商解决剩余歧义,最终确定规范。该方法将焦点从代码生成转向规范定义,凸显人机协作是未来智能体设计的关键方向。

原文摘要 · Abstract (English)

Today's agents are highly effective at implementing well-scoped software design plans, but user intent is often vague and admits multiple equally valid solutions. In this paper, we introduce SpecBench, a new benchmark for evaluating an agent's ability to translate user intent into a structured, executable specification that aligns with user preferences. The agent is given access to past user conversations and may interact with the user for a fixed number of rounds to ask clarifying questions. We find that existing agents exhibit two extreme behaviors: they either (i) struggle to collaborate proactively with users, entering implementation mode too quickly while overestimating their understanding of user preferences, or (ii) exhaust their question budget by asking about every ambiguous design choice. To address this limitation, we introduce a user-assistant agent: Buddy. It follows a workflow inspired by classical morphological analysis, decomposing user intent into a structured space of design dimensions and candidate choices. It then creates simulated users to evaluate these choices, before engaging the real user to resolve remaining ambiguities and finalize the specification. By shifting the focus from execution to specification, SpecBench and Buddy emphasize agent-user collaboration (not just code generation) as a key frontier in future agent design.

人机协作智能体需求理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。