用5W3H结构化提示提升跨语言跨模型的对话对齐性。
Does Structured Intent Representation Generalize? A Cross-Language, Cross-Model Empirical Study of 5W3H Prompting
- 通过AI辅助将简单提示自动转为5W3H结构,用户只需输入一句话。
- 结构化提示在三语言中与人工构造效果相当,且降低跨模型输出差异。
- 适合希望简化提示设计、提升多模型一致性的非专家用户。
结构化意图表示能否跨语言和模型泛化?我们研究了基于5W3H的提示协议规范(PPS)框架,在中文之外扩展至英语和日语,并新增两种条件:一是用户仅需简短输入,由AI辅助界面自动生成完整5W3H;二是考察跨模型输出一致性。在2,160次模型输出(3语言×4条件×3大模型×60任务)中发现,AI生成的5W3H提示(条件D)在目标对齐性上与人工构建的5W3H提示(条件C)无显著差异,且用户仅需单句输入。结构化提示常能减少或重构跨模型输出方差,但效果因语言和指标而异;最有力证据来自识别出无约束基线中的虚假低方差现象。此外,非结构化提示存在系统性双重膨胀偏差:复合评分虚高,跨模型方差显得过低。结果表明,5W3H结构可有效提升跨语言跨模型的意图对齐与可用性,尤其在降低非专家用户门槛时优势明显。
原文摘要 · Abstract (English)
Does structured intent representation generalize across languages and models? We study PPS (Prompt Protocol Specification), a 5W3H-based framework for structured intent representation in human-AI interaction, and extend prior Chinese-only evidence along three dimensions: two additional languages (English and Japanese), a fourth condition in which a user's simple prompt is automatically expanded into a full 5W3H specification by an AI-assisted authoring interface, and a new research question on cross-model output consistency. Across 2,160 model outputs (3 languages x 4 conditions x 3 LLMs x 60 tasks), we find that AI-expanded 5W3H prompts (Condition D) show no statistically significant difference in goal alignment from manually crafted 5W3H prompts (Condition C) across all three languages, while requiring only a single-sentence input from the user. Structured PPS conditions often reduce or reshape cross-model output variance, though this effect is not uniform across languages and metrics; the strongest evidence comes from identifying spurious low variance in unconstrained baselines. We also show that unstructured prompts exhibit a systematic dual-inflation bias: artificially high composite scores and artificially low apparent cross-model variance. These findings suggest that structured 5W3H representations can improve intent alignment and accessibility across languages and models, especially when AI-assisted authoring lowers the barrier for non-expert users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。