arXiv:2412.18048cs.HCcs.AI2024-12被引 1

对比深度学习与机器学习在语言习得预测中的公平性表现

Fair Knowledge Tracing in Second Language Acquisition

  • 用深度学习和机器学习建模语言学习者知识掌握情况
  • 移动端用户和发达国家学习者普遍受优待,模型存在系统偏差
  • 深度学习在多数语种中更公平,适合跨平台跨区域教育应用

在第二语言习得中,预测建模帮助教师实施差异化教学策略,受到广泛关注。然而,尽管模型准确性被广泛研究,公平性却未得到足够重视。模型公平性确保各群体获得公正对待,避免因性别、族裔或经济背景等属性产生无意偏见。本研究基于Duolingo数据集的en_es(西班牙语母语者学英语)、es_en(英语母语者学西班牙语)和fr_en(法语母语者学英语)学习轨迹,评估两类预测模型的公平性:1. 不同平台(iOS、Android、Web)间的算法公平性;2. 发达国家与发展中地区之间的公平性。关键发现包括:1. 深度学习在语言知识追踪中优于传统机器学习,兼具更高准确率与更好公平性;2. 两类模型均更偏向移动端用户;3. 机器学习对发展中国家学习者的偏见强于深度学习;4. 在en_es与es_en轨迹中,深度学习在公平性与准确性间取得更好平衡,而机器学习更适合fr_en场景。研究强调,在教育预测模型中关注公平性,对实现跨平台、跨区域的公平教学策略至关重要。

原文摘要 · Abstract (English)

In second-language acquisition, predictive modeling aids educators in implementing diverse teaching strategies, attracting significant research attention. However, while model accuracy is widely explored, model fairness remains under-examined. Model fairness ensures equitable treatment of groups, preventing unintentional biases based on attributes such as gender, ethnicity, or economic background. A fair model should produce impartial outcomes that do not systematically disadvantage any group. This study evaluates the fairness of two predictive models using the Duolingo dataset's en\_es (English learners speaking Spanish), es\_en (Spanish learners speaking English), and fr\_en (French learners speaking English) tracks. We analyze: 1. Algorithmic fairness across platforms (iOS, Android, Web). 2. Algorithmic fairness between developed and developing countries. Key findings include: 1. Deep learning outperforms machine learning in second-language knowledge tracing due to improved accuracy and fairness. 2. Both models favor mobile users over non-mobile users. 3. Machine learning exhibits stronger bias against developing countries compared to deep learning. 4. Deep learning strikes a better balance of fairness and accuracy in the en\_es and es\_en tracks, while machine learning is more suitable for fr\_en. This study highlights the importance of addressing fairness in predictive models to ensure equitable educational strategies across platforms and regions.

知识追踪语言学习公平性深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。