用AI对话日志分析药学学生问诊模式,发现高手会聚焦关键信息。
Uncovering Students' Inquiry Patterns in GenAI-Supported Clinical Practice: An Integration of Epistemic Network Analysis and Sequential Pattern Mining
- 结合认知网络与序列挖掘,分析学生与AI虚拟患者对话
- 高分学生更擅长识别临床信息并整合沟通结构
- 适合关注AI教育评估与个性化学习系统设计者
药学临床训练中病史采集的评估长期依赖人工观察,难以规模化且缺乏细致数据。尽管生成式AI(GenAI)平台可实现大规模数据采集,学习分析方法也提供了分析教育轨迹的强大工具,但两者在药学临床培训中的应用仍不充分。本研究通过学习分析,探究学生在使用GenAI虚拟患者时如何发展临床沟通能力——这一问题在学生背景多样、语言差异大、传统训练中反馈机会有限的背景下尤为关键。我们分析了来自澳大利亚和马来西亚机构的323名学生的交互日志,包含1,487次学生-GenAI对话中的50,871条编码语句。结合认知网络分析(Epistemic Network Analysis)以建模提问共现关系,以及序列模式挖掘(Sequential Pattern Mining)以捕捉时间序列行为,发现高绩效学生展现出有策略地运用信息识别行为:他们聚焦于识别临床相关资讯,同时整合建立关系与结构组织;而低绩效学生则困于例行性问答验证循环。此外,母语背景、既往药学工作经验及机构环境等人口统计因素也影响了不同的提问模式。这些发现揭示了在GenAI辅助情境下可能反映临床推理发展的提问模式,为健康专业教育评估提供方法论启示,并指导自适应GenAI系统设计以支持多样化学习路径。
原文摘要 · Abstract (English)
Assessment of medication history-taking has traditionally relied on human observation, limiting scalability and detailed performance data. While Generative AI (GenAI) platforms enable extensive data collection and learning analytics provide powerful methods for analyzing educational traces, these approaches remain largely underexplored in pharmacy clinical training. This study addresses this gap by applying learning analytics to understand how students develop clinical communication competencies with GenAI-powered virtual patients -- a crucial endeavor given the diversity of student cohorts, varying language backgrounds, and the limited opportunities for individualized feedback in traditional training settings. We analyzed 323 students' interaction logs across Australian and Malaysian institutions, comprising 50,871 coded utterances from 1,487 student-GenAI dialogues. Combining Epistemic Network Analysis to model inquiry co-occurrences with Sequential Pattern Mining to capture temporal sequences, we found that high performers demonstrated strategic deployment of information recognition behaviors. Specifically, high performers centered inquiry on recognizing clinically relevant information, integrating rapport-building and structural organization, while low performers remained in routine question-verification loops. Demographic factors including first-language background, prior pharmacy work experience, and institutional context, also shaped distinct inquiry patterns. These findings reveal inquiry patterns that may indicate clinical reasoning development in GenAI-assisted contexts, providing methodological insights for health professions education assessment and informing adaptive GenAI system design that supports diverse learning pathways.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。