对话系统需判断用户表达是否真正准备好执行,而非仅理解语义。
WHEN TO ACT, WHEN TO WAIT: Modeling the Intent-Action Alignment Problem in Dialogue
- 用双模型模拟用户与系统间信息不对称的对话过程
- 中等不确定性(40%-60%)反而比完全透明更有效
- 适合研究人机协作中意图演化与决策时机的学者
对话系统在用户语句语义完整但缺乏行动明确性时常失效。这是因为用户往往不完全了解自身需求,而系统需精准定义意图。这凸显了关键的意图-动作对齐问题:何时表达不仅被理解,且真正可执行。本文提出STORM框架,通过用户大模型(UserLLM,有内部访问权)与代理大模型(AgentLLM,仅可观测行为)之间的对话,建模信息不对称动态。该框架生成标注语料库,记录表达措辞变化与潜在认知转变轨迹,支持对协同理解演化的系统分析。贡献包括:(1) 形式化对话系统中的信息不对称处理;(2) 建模意图形成以追踪协同理解演变;(3) 提出同时衡量内在认知提升与任务性能的评估指标。四类语言模型实验表明,在某些场景下中等不确定性(40%-60%)优于完全透明,且存在模型特异性模式,提示需重新思考人机协作中信息完备性的最优标准。这些发现有助于理解非对称推理动态,并指导具备不确定性校准能力的对话系统设计。
原文摘要 · Abstract (English)
Dialogue systems often fail when user utterances are semantically complete yet lack the clarity and completeness required for appropriate system action. This mismatch arises because users frequently do not fully understand their own needs, while systems require precise intent definitions. This highlights the critical Intent-Action Alignment Problem: determining when an expression is not just understood, but truly ready for a system to act upon. We present STORM, a framework modeling asymmetric information dynamics through conversations between UserLLM (full internal access) and AgentLLM (observable behavior only). STORM produces annotated corpora capturing trajectories of expression phrasing and latent cognitive transitions, enabling systematic analysis of how collaborative understanding develops. Our contributions include: (1) formalizing asymmetric information processing in dialogue systems; (2) modeling intent formation tracking collaborative understanding evolution; and (3) evaluation metrics measuring internal cognitive improvements alongside task performance. Experiments across four language models reveal that moderate uncertainty (40-60%) can outperform complete transparency in certain scenarios, with model-specific patterns suggesting reconsideration of optimal information completeness in human-AI collaboration. These findings contribute to understanding asymmetric reasoning dynamics and inform uncertainty-calibrated dialogue system design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。