通过多层级用户控制提升教育推荐系统的透明度与信任感
Designing and Evaluating an Educational Recommender System with Different Levels of User Control
- 在输入、过程、输出三阶段设计不同层级用户控制
- 30人在线实验表明控制权显著提升系统透明度与满意度
- 适合关注教育AI可解释性与用户参与感的研究者
教育推荐系统(ERS)通过个性化资源推荐改善学习体验与成效,但常因用户控制不足和透明度欠缺而效果受限。本文系统设计并评估了一种交互式教育推荐系统,引入用户对输入(用户画像)、过程(推荐算法)和输出(推荐结果)三个环节的多层次控制。通过一项包含30名用户的在线研究,考察用户控制对系统透明度、信任感和满意度等关键用户体验维度的影响及其相互关系。结果表明,用户控制显著提升感知收益,与透明度强相关,与信任和满意度中等相关;透明度与满意度呈中等相关,信任与满意度强相关,而透明度与信任关联较弱。
原文摘要 · Abstract (English)
Educational recommender systems (ERSs) play a crucial role in personalizing learning experiences and enhancing educational outcomes by providing recommendations of personalized resources and activities to learners, tailored to their individual learning needs. However, their effectiveness is often diminished by insufficient user control and limited transparency. To address these challenges, in this paper, we present the systematic design and evaluation of an interactive ERS, in which we introduce different levels of user control. Concretely, we introduce user control around the input (i.e., user profile), process (i.e., recommendation algorithm), and output (i.e., recommendations) of the ERS. To evaluate our system, we conducted an online user study (N=30) to explore the impact of user control on users' perceptions of the ERS in terms of several important user-centric aspects. Moreover, we investigated the effects of user control on multiple recommendation goals, namely transparency, trust, and satisfaction, as well as the interactions between these goals. Our results demonstrate the positive impact of user control on user perceived benefits of the ERS. Moreover, our study shows that user control strongly correlates with transparency and moderately correlates with trust and satisfaction. In terms of interaction between these goals, our results reveal that transparency moderately correlates and trust strongly correlates with satisfaction. Whereas, transparency and trust stand out as less correlated with each other.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。