arXiv:2603.18976cs.AI2026-03被引 4

用5W3H结构化提示提升人机交互中的意图对齐,减少沟通误差。

Evaluating 5W3H Structured Prompting for Intent Alignment in Human-AI Interaction

  • 基于5W3H框架设计结构化提示,让用户意图更清晰表达。
  • 自然语言渲染的提示比简单提示和原始JSON在意图对齐上提升40%以上。
  • 适合高模糊性任务如商业分析,能减少66%的后续追问次数。

自然语言提示常存在意图传递损耗:用户真实需求与向AI传达的内容之间存在差距。本文评估了基于5W3H的提示协议规范(PPS)框架在人机交互中结构化意图表达的效果。在三个领域(商业、技术、旅行)共60个任务中,使用三个大模型(DeepSeek-V3、Qwen-Max、Kimi)和三种提示条件(A)简单提示,(B)原始PPS JSON,(C)自然语言渲染的PPS),收集540条AI生成结果并由大模型判别器评估。引入以用户意图为中心的‘目标对齐’评价维度,发现自然语言渲染的PPS显著优于简单提示和原始JSON。PPS效果具任务依赖性:在高模糊性的商业分析任务中提升显著,但在低模糊性的旅行规划任务中反而下降。还发现标准大模型评估存在测量不对称性,自由提示会虚高约束遵守率,掩盖结构化提示的实际价值。初步回顾性调查(N=20)显示,后续提问轮次从3.33轮降至1.13轮,减少66.1%。结果表明,结构化意图表达可有效提升人机交互中的对齐度与可用性,尤其适用于意图本身模糊的任务。

原文摘要 · Abstract (English)

Natural language prompts often suffer from intent transmission loss: the gap between what users actually need and what they communicate to AI systems. We evaluate PPS (Prompt Protocol Specification), a 5W3H-based framework for structured intent representation in human-AI interaction. In a controlled three-condition study across 60 tasks in three domains (business, technical, and travel), three large language models (DeepSeek-V3, Qwen-Max, and Kimi), and three prompt conditions - (A) simple prompts, (B) raw PPS JSON, and (C) natural-language-rendered PPS - we collect 540 AI-generated outputs evaluated by an LLM judge. We introduce goal_alignment, a user-intent-centered evaluation dimension, and find that rendered PPS outperforms both simple prompts and raw JSON on this metric. PPS gains are task-dependent: gains are large in high-ambiguity business analysis tasks but reverse in low-ambiguity travel planning. We also identify a measurement asymmetry in standard LLM evaluation, where unconstrained prompts can inflate constraint adherence scores and mask the practical value of structured prompting. A preliminary retrospective survey (N = 20) further suggests a 66.1% reduction in follow-up prompts required, from 3.33 to 1.13 rounds. These findings suggest that structured intent representations can improve alignment and usability in human-AI interaction, especially in tasks where user intent is inherently ambiguous.

人机交互意图对齐结构化提示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。