用因果模型分析教学干预对学生成绩的影响,支持真实干预与反事实推断。
Causal Modelling of Support Interventions for Student Competency Assessment
- 基于结构因果模型构建教育评估框架,支持干预与反事实推理。
- 在算法能力测评数据上验证了提示等干预措施的因果效应。
- 无需概率假设,仅需专家逻辑判断即可建模,更可信易用。
准确评估学生能力对识别个体需求、设计针对性干预和评估教育策略效果至关重要。传统评估多基于心理测量模型(如项目反应理论),将能力水平与任务表现关联。本文倡导采用结构因果建模方法,突破概率性信念更新,建立可支持干预与反事实推理的教育评估框架。提出一套建模协议,分析标准关联模型无法实现的推理形式,如显式建模提示等干预手段及其反事实情景。尽管需专家提供结构方程,但所需信息仅为逻辑关系,不依赖难以验证的概率假设。研究使用复杂任务评估中小学生算法技能的数据验证该方法,展示了其实际应用价值。
原文摘要 · Abstract (English)
Accurate assessment of student competencies is essential for enabling educators to identify individual needs, design targeted interventions, and evaluate the effectiveness of educational strategies. Empirical assessment procedures are typically grounded in psychometric models, such as item response theory, which relate student competence levels to performance on assessment tasks. In this paper, we advocate adopting a structural causal modelling approach to educational assessment, moving beyond probabilistic belief updating toward a framework that explicitly supports interventional and counterfactual reasoning. We propose a corresponding protocol for its construction and analyse the practical relevance of forms of reasoning that remain inaccessible to standard associative models, including the explicit modelling of interventions such as hints and the related counterfactual scenario analysis. Although our protocol requires the structural equations to be elicited from experts, the necessary information is purely logical and does not rely on probabilistic, less tenable assumptions. We illustrate the approach using data from an assessment that employs complex tasks designed to measure compulsory school student algorithmic skills.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。