对比手点与视线点在XR中的表现，发现不同失误模式需针对性优化。
The Midas Touch in Gaze vs. Hand Pointing: Modality-Specific Failure Modes and Implications for XR Interfaces
- 设计自适应干预：视线去干扰、手点目标增宽
- 手点速度更快、错误率更低，视线主要因误触出错
- 揭示不同模态的失败机制，为智能交互设计提供依据
扩展现实（XR）界面带来生理与认知负担，现有系统常在手控输入（易疲劳）与视线输入（易受‘金手指’效应影响）间二选一。本文提出xr-adaptive-modality-2025平台，一个基于网页的开源框架，用于研究模态特异性自适应干预是否能提升指向性能并降低负荷。该平台融合生理学驱动的视线模拟、ISO 9241-9多方向点击任务，以及两种自适应策略：视线去干扰与手点目标宽度扩大。通过2×2×2被试内设计（模态：手/视线；界面模式：静态/自适应；压力：有/无），对69名参与者进行测试。结果表明，手控比视线更优：吞吐量更高（5.17 vs. 4.73 bit/s），错误率更低（1.8% vs. 19.1%），NASA-TLX负荷更低。关键差异在于错误类型：视线错误以滑动为主（99.2%），手控错误以遗漏为主（95.7%），符合‘金手指’理论。仅视线去干扰可评估，其轻微减少超时但未改善滑动；手点扩宽因界面集成缺陷无法评估。研究揭示模态特异性失效模式，为自适应策略设计提供依据，并建立可复现的研究基础设施。
原文摘要 · Abstract (English)
Extended Reality (XR) interfaces impose both ergonomic and cognitive demands, yet current systems often force a binary choice between hand-based input, which can produce fatigue, and gaze-based input, which is vulnerable to the Midas Touch problem and precision limitations. We introduce the xr-adaptive-modality-2025 platform, a web-based open-source framework for studying whether modality-specific adaptive interventions can improve XR-relevant pointing performance and reduce workload relative to static unimodal interaction. The platform combines physiologically informed gaze simulation, an ISO 9241-9 multidirectional tapping task, and two modality-specific adaptive interventions: gaze declutter and hand target-width inflation. We evaluated the system in a 2 x 2 x 2 within-subjects design manipulating Modality (Hand vs. Gaze), UI Mode (Static vs. Adaptive), and Pressure (Yes vs. No). Results from N=69 participants show that hand yielded higher throughput than gaze (5.17 vs. 4.73 bits/s), lower error (1.8% vs. 19.1%), and lower NASA-TLX workload. Crucially, error profiles differed sharply by modality: gaze errors were predominantly slips (99.2%), whereas hand errors were predominantly misses (95.7%), consistent with the Midas Touch account. Of the two adaptive interventions, only gaze declutter executed in this dataset; it modestly reduced timeouts but not slips. Hand width inflation was not evaluable due to a UI integration bug. These findings reveal modality-specific failure modes with direct implications for adaptive policy design, and establish the platform as a reproducible infrastructure for future studies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。