arXiv:2510.14611cs.HCcs.AI2025-10中稿 · 6th International …被引 2

用主动推理模拟鼠标点击行为,能自适应不同难度任务。

An Active Inference Model of Mouse Point-and-Click Behaviour

  • 基于预期自由能最小化选择动作,仅依赖对感知的偏好分布。
  • 生成的点击轨迹与人类用户相似,端点方差接近真实数据。
  • 无需调参即可应对不同目标难度,具备概率性延迟补偿能力。

我们探索主动推理(AIF)作为人机交互中空间指针行为的计算用户模型。提出一个具有连续状态、动作和观测空间的AIF代理,执行一维鼠标指针定位与点击。通过简单动态系统建模鼠标的实际感知延迟。与以往基于最优反馈控制的模型不同,该代理通过最小化预期自由能来选择动作,仅依赖对感知结果的偏好分布(如正确点击按钮)。结果表明,当光标位于目标上时,代理可生成合理指向运动并完成点击,其终点方差与人类用户相当。相比其他指针模型,本方法在代理中完全融入了概率性预测延迟补偿机制。代理能自然表现出不同目标难度下的差异行为,无需重新调整系统参数。我们讨论了仿真结果,并强调在连续系统中识别正确AIF配置所面临的挑战。

原文摘要 · Abstract (English)

We explore the use of Active Inference (AIF) as a computational user model for spatial pointing, a key problem in Human-Computer Interaction (HCI). We present an AIF agent with continuous state, action, and observation spaces, performing one-dimensional mouse pointing and clicking. We use a simple underlying dynamic system to model the mouse cursor dynamics with realistic perceptual delay. In contrast to previous optimal feedback control-based models, the agent's actions are selected by minimizing Expected Free Energy, solely based on preference distributions over percepts, such as observing clicking a button correctly. Our results show that the agent creates plausible pointing movements and clicks when the cursor is over the target, with similar end-point variance to human users. In contrast to other models of pointing, we incorporate fully probabilistic, predictive delay compensation into the agent. The agent shows distinct behaviour for differing target difficulties without the need to retune system parameters, as done in other approaches. We discuss the simulation results and emphasize the challenges in identifying the correct configuration of an AIF agent interacting with continuous systems.

主动推理人机交互动作建模概率推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。