对比学生用谷歌和ChatGPT学编程，发现传统方法更易懂。
To Google or To ChatGPT? A Comparison of CS2 Students' Information Gathering Approaches and Outcomes
- 让学生在两种方式间切换学习，观察其策略差异。
- 用传统方法学难概念时效果更好，正确率更高。
- 用谷歌多用关键词搜索，用ChatGPT则直接提问。
大型语言模型（如ChatGPT）已被大学生广泛用于编程学习。然而，学生使用这些工具的效率及其学习策略仍不明确。由于多数学生在线自学依赖搜索引擎（如谷歌），在这一背景下评估AI工具有助于填补空白。本研究采用混合方法，开展探索性被试内实验，考察计算机科学二年级学生在使用大模型与传统在线资源（如教育网站、视频）学习编程概念时的不同方式。结果显示，学生在使用传统方法学习较难概念时表现更优；使用谷歌时更多采用关键词式查询并提出较少追问，而向ChatGPT提问时则倾向于明确索要信息。
原文摘要 · Abstract (English)
LLMs such as ChatGPT have been widely adopted by students in higher education as tools for learning programming and related concepts. However, it remains unclear how effective students are and what strategies students use while learning with LLMs. Since the majority of students' experiences in online self-learning have come through using search engines such as Google, evaluating AI tools in this context can help us address these gaps. In this mixed methods research, we conducted an exploratory within-subjects study to understand how CS2 students learn programming concepts using both LLMs as well as traditional online methods such as educational websites and videos to examine how students approach learning within and across both scenarios. We discovered that students found it easier to learn a more difficult concept using traditional methods than using ChatGPT. We also found that students ask fewer follow-ups and use more keyword-based queries for search engines while their prompts to LLMs tend to explicitly ask for information.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。