arXiv:2409.15631cs.LGcs.AI2024-09被引 13

用生成AI填补学习数据空白,提升预测准确性

Data Augmentation for Sparse Multidimensional Learning Performance Data Using Generative AI

  • 将学习行为建模为三维张量,用张量分解补全缺失数据
  • 张量分解使知识追踪准确率优于传统方法,且稳定性更强
  • 基于GAN的生成模型比GPT更少偏差,适合模拟学习模式

学习性能数据描述自适应学习系统中正确的答案、错误的答案或解题尝试。由于自适应题目选择,真实应用中这类数据通常高度稀疏(缺失观测值占80%~90%),给学习者模型预测未来表现或探索学习假设带来挑战。本文提出一种系统性框架,通过生成式AI增强稀疏学习性能数据。首先,将学习表现表示为学习者、问题、作答次数构成的三维张量,捕捉学习过程中的纵向知识状态。其次,采用张量分解方法对收集到的学习者数据张量进行缺失值补全,基于真实观察值预测缺失性能,实现知识追踪任务的合理填充。第三,引入生成学习模式模块,对比使用生成对抗网络(GAN)与生成预训练变换器(GPT)两种生成式AI方法,在不同学习者聚类数据上生成模拟数据。在针对成人阅读理解(ARC)课程开发的AutoTutor数据集上测试发现:(1) 张量分解显著提升了知识追踪与知识掌握预测的性能,相比其他无数据增强的知识追踪技术具有更高相对保真度;(2) 基于GAN的模拟在不同样本规模下表现出更强的整体稳定性和更低的统计偏差,优于GPT。

原文摘要 · Abstract (English)

Learning performance data describe correct and incorrect answers or problem-solving attempts in adaptive learning, such as in intelligent tutoring systems (ITSs). Learning performance data tend to be highly sparse (80\%\(\sim\)90\% missing observations) in most real-world applications due to adaptive item selection. This data sparsity presents challenges to using learner models to effectively predict future performance explore new hypotheses about learning. This article proposes a systematic framework for augmenting learner data to address data sparsity in learning performance data. First, learning performance is represented as a three-dimensional tensor of learners' questions, answers, and attempts, capturing longitudinal knowledge states during learning. Second, a tensor factorization method is used to impute missing values in sparse tensors of collected learner data, thereby grounding the imputation on knowledge tracing tasks that predict missing performance values based on real observations. Third, a module for generating patterns of learning is used. This study contrasts two forms of generative Artificial Intelligence (AI), including Generative Adversarial Networks (GANs) and Generate Pre-Trained Transformers (GPT) to generate data associated with different clusters of learner data. We tested this approach on an adult literacy dataset from AutoTutor lessons developed for Adult Reading Comprehension (ARC). We found that: (1) tensor factorization improved the performance in tracing and predicting knowledge mastery compared with other knowledge tracing techniques without data augmentation, showing higher relative fidelity for this imputation method, and (2) the GAN-based simulation showed greater overall stability and less statistical bias based on a divergence evaluation with varying simulation sample sizes compared to GPT.

数据增强知识追踪生成模型稀疏数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。