提出新方法,让考试一次选题就能精准匹配学生水平。
PEOAT: Personalization-Guided Evolutionary Question Assembly for One-Shot Adaptive Testing

- 用进化算法优化题目组合,考虑学生能力与题目难度匹配。
- 实验显示在两个数据集上显著提升评估准确率。
- 适合资源紧张或需快速测评的教育场景。
随着智能教育快速发展,计算机自适应测试(CAT)通过结合教育心理学与深度学习技术,实现了根据考生能力动态选题,从而高效准确地评估能力。然而,其实时、顺序性特点在大规模评估中带来高交互成本,在心理测评等敏感领域也易受噪声干扰,限制了实际应用。为此,我们首次提出一次性自适应测试(OAT)任务,旨在为每位考生一次性选定最优题组。同时,提出个性化引导的进化题组组装框架PEOAT,从组合优化视角解决该问题。首先设计了感知个性化的初始化策略,融合考生能力与题目难度差异,采用多策略采样构建多样且信息丰富的初始种群;在此基础上,提出认知增强的进化框架,引入保留结构的交叉与认知引导的变异操作,实现高效探索;为保持多样性而不牺牲适应度,进一步设计了多样性感知的环境选择机制。PEOAT在两个数据集上经大量实验验证有效,并通过案例研究揭示了重要洞见。
原文摘要 · Abstract (English)
With the rapid advancement of intelligent education, Computerized Adaptive Testing (CAT) has attracted increasing attention by integrating educational psychology with deep learning technologies. Unlike traditional paper-and-pencil testing, CAT aims to efficiently and accurately assess examinee abilities by adaptively selecting the most suitable items during the assessment process. However, its real-time and sequential nature presents limitations in practical scenarios, particularly in large-scale assessments where interaction costs are high, or in sensitive domains such as psychological evaluations where minimizing noise and interference is essential. These challenges constrain the applicability of conventional CAT methods in time-sensitive or resourceconstrained environments. To this end, we first introduce a novel task called one-shot adaptive testing (OAT), which aims to select a fixed set of optimal items for each test-taker in a one-time selection. Meanwhile, we propose PEOAT, a Personalization-guided Evolutionary question assembly framework for One-shot Adaptive Testing from the perspective of combinatorial optimization. Specifically, we began by designing a personalization-aware initialization strategy that integrates differences between examinee ability and exercise difficulty, using multi-strategy sampling to construct a diverse and informative initial population. Building on this, we proposed a cognitive-enhanced evolutionary framework incorporating schema-preserving crossover and cognitively guided mutation to enable efficient exploration through informative signals. To maintain diversity without compromising fitness, we further introduced a diversity-aware environmental selection mechanism. The effectiveness of PEOAT is validated through extensive experiments on two datasets, complemented by case studies that uncovered valuable insights.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。