arXiv:2509.11547cs.AI2025-09

用合成数据提升眼动追踪任务解码准确率,最高达82%。

Task Decoding based on Eye Movements using Synthetic Data Augmentation

  • 通过CTGAN等生成合成眼动数据,扩充真实数据集。
  • 数据量增至5倍时,分类准确率从28.1%升至82%。
  • 适用于眼动研究、注意力分析与人机交互领域。

机器学习在眼动追踪研究中广泛应用。理解眼动模式是揭示个体扫描行为的重要方向。传统机器学习方法对基于眼动数据的任务解码结果褒贬不一,难以验证叶尔巴斯(Yarbus)提出的“可通过眼动推断观察任务”假设。本文利用已有的真人用户研究数据,采用CTGAN、CopulaGAN及Gretel AI等合成数据生成器生成合成样本,增强眼动数据。实验表明,结合更多合成数据可显著提升分类准确率,即使使用传统机器学习算法亦然。当真实数据集(320个样本)增加至五倍时,随机森林准确率从28.1%提升至82%(采用Inception Time)。所提框架因引入额外合成数据,在该数据集上优于现有研究。通过多种算法和真实/合成数据组合验证,证明解码准确率随数据增强而提升。

原文摘要 · Abstract (English)

Machine learning has been extensively used in various applications related to eye-tracking research. Understanding eye movement is one of the most significant subsets of eye-tracking research that reveals the scanning pattern of an individual. Researchers have thoroughly analyzed eye movement data to understand various eye-tracking applications, such as attention mechanisms, navigational behavior, task understanding, etc. The outcome of traditional machine learning algorithms used for decoding tasks based on eye movement data has received a mixed reaction to Yarbus' claim that it is possible to decode the observer's task from their eye movements. In this paper, to support the hypothesis by Yarbus, we are decoding tasks categories while generating synthetic data samples using well-known Synthetic Data Generators CTGAN and its variations such as CopulaGAN and Gretel AI Synthetic Data generators on available data from an in-person user study. Our results show that augmenting more eye movement data combined with additional synthetically generated improves classification accuracy even with traditional machine learning algorithms. We see a significant improvement in task decoding accuracy from 28.1% using Random Forest to 82% using Inception Time when five times more data is added in addition to the 320 real eye movement dataset sample. Our proposed framework outperforms all the available studies on this dataset because of the use of additional synthetic datasets. We validated our claim with various algorithms and combinations of real and synthetic data to show how decoding accuracy increases with the increase in the augmentation of generated data to real data.

眼动追踪合成数据任务解码机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。