arXiv:2503.16440cs.HCcs.AI2025-03中稿 · Frontiers in Cogni…

人在虚拟现实中通过动作学习因果关系,意识与身体感知的机制不同。

Cause-effect perception in an object place task

  • 通过反复放置玻璃杯,观察意识与身体动作对因果关系的感知差异。
  • 76%的人识别出重量影响易碎性,43%识别颜色影响,但方向判断困难。
  • 身体动作层面显示重量-受力强关联,适合研究人机协同中的因果学习。

我们开展了一项虚拟现实探索性研究,考察人类在真实感官运动情境中能否发现因果关系,以及这种学习在不同认知层级(意识-认知与感官运动)如何表征。同时探讨了人类因果学习与当前先进因果发现算法的关系。任务为将不同重量和颜色的玻璃杯放置于表面,当接触力超过其易碎阈值时杯子会破裂。通过触觉反馈模拟重量与接触力以增强生态效度。参与者需多次运输并放置玻璃杯而不打破,成功依赖于发现底层因果结构。实验分三阶段进行,反映从初始尝试到行为固化及因果意识形成的过程,并通过问卷评估其对因果结构的意识理解。传感器运动表征通过应用因果发现算法(PC、FCI、FGES)分析逐次试验变量推断,条件互信息用于量化感官运动层面的因果影响强度。结果显示:(i) 参与者在实验后76%正确识别重量-易碎性关联,43%识别颜色-易碎性关联,但难以确定因果方向;(ii) 感官运动分析显示重量-受力耦合随实验阶段显著增强,而颜色-受力关联较弱且噪声大,但互信息表明存在尝试性学习;(iii) 因果发现算法在各阶段均恢复了真实因果结构。综合表明,人类可部分感知任务因果结构,且意识与感官运动表征存在部分分离。

原文摘要 · Abstract (English)

We conducted an exploratory study in virtual reality to examine if people can discover causal relations in a realistic sensorimotor context and how such learning is represented at different processing levels (conscious-cognitive vs. sensorimotor). Additionally, we explored the relation between human causal learning and state-of-the-art causal discovery algorithms. The task consisted of placing a glass on a surface, that breaks if the contact force exeeded its breakability threshold, determined by weight and color. Ecological validity was enhanced by haptic rendering simulating weight and contact forces. Participants were asked to repeatedly transport and place glasses of varying weights and colors on a surface without breaking them. For success, participants had to discover the underlying causal structure. The trials were conducted over three sessions, reflecting naive, exploratory, consolidated and causally aware behavior, with questionnaires assessing conscious causal understanding of the task's causal structure. Sensorimotor representations were inferred by applying causal-discovery algorithms (PC, FCI, FGES) to the recorded trial-by-trial variables, and conditional mutual information was used to quantify the strength of causal influence on the sensorimotor level. Results show that (i) participants identified the weight-breakability link (76% correct after experiment) and the color-breakability link (43%) but struggle to infer causal direction. (ii) Sensorimotor analysis revealed a robust weight-force coupling increasing across sessions, whereas for color-force it was weak and noisy, yet mutual information indicated an attempted learning. (iii) Discovery algorithms recovered the causal structure across sessions. Together, these findings indicate that humans can, partially, perceive the causal structure of the task, with partially dissociated conscious and sensorimotor representations.

因果学习虚拟现实感官运动人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。