arXiv:2508.12268cs.HCcs.CV2025-08被引 2

用点击操作在Vision Pro上实现高精度眼动可视化,突破隐私限制。

iTrace: Click-Based Gaze Visualization on the Apple Vision Pro

  • 通过捏合手势、停留控制或游戏手柄触发点击,间接获取眼动数据。
  • 8BitDo手柄达14.22次/秒点击率,热图密度显著高于停留控制的0.45次/秒。
  • 支持个人与群体注意力分析,适用于教育、设计、营销等研究场景。

Apple Vision Pro具备精准眼动追踪能力,但设备隐私限制使其无法直接访问连续眼动数据。本研究提出iTrace,一种基于点击的眼动提取新方法,包含手动捏合手势及自动停留控制或游戏控制器方案。系统采用客户端-服务器架构,捕获眼动坐标并生成动态热图,支持个体与平均热图生成,用于分析个人与集体注意力模式。两组各10名参与者测试不同点击方式:8BitDo控制器平均点击率达14.22次/秒,远超停留控制的0.45次/秒,显著提升热图密度。热图显示讲座视频中注意力集中,解题任务中扫描范围更广。系统保持91%高精度,展现出在教育内容参与度、环境设计评估、营销分析和临床认知评估中的广泛应用潜力。鉴于当前Vision Pro的眼动数据限制,建议仅限研究用途使用iTrace。

原文摘要 · Abstract (English)

The Apple Vision Pro is equipped with accurate eye-tracking capabilities, yet the privacy restrictions on the device prevent direct access to continuous user gaze data. This study introduces iTrace, a novel application that overcomes these limitations through click-based gaze extraction techniques, including manual methods like a pinch gesture, and automatic approaches utilizing dwell control or a gaming controller. We developed a system with a client-server architecture that captures the gaze coordinates and transforms them into dynamic heatmaps for video and spatial eye tracking. The system can generate individual and averaged heatmaps, enabling analysis of personal and collective attention patterns. To demonstrate its effectiveness and evaluate the usability and performance, a study was conducted with two groups of 10 participants, each testing different clicking methods. The 8BitDo controller achieved higher average data collection rates at 14.22 clicks/s compared to 0.45 clicks/s with dwell control, enabling significantly denser heatmap visualizations. The resulting heatmaps reveal distinct attention patterns, including concentrated focus in lecture videos and broader scanning during problem-solving tasks. By allowing dynamic attention visualization while maintaining a high gaze precision of 91 %, iTrace demonstrates strong potential for a wide range of applications in educational content engagement, environmental design evaluation, marketing analysis, and clinical cognitive assessment. Despite the current gaze data restrictions on the Apple Vision Pro, we encourage developers to use iTrace only in research settings.

眼动追踪视觉交互AR应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。