主动修改AI生成内容能显著提升作文质量。
Modifying AI, Enhancing Essays: How Active Engagement with Generative AI Boosts Writing Quality
- 通过分析1445次写作行为，发现修改AI内容比直接采纳更能促进高质量输出。
- 主动修改者在词汇复杂度、句式多样性和文本连贯性上均显著提升。
- 即使不修改AI内容，也能缓解人类作者的语言偏见问题。
学生越来越依赖生成式人工智能（GAI）辅助写作——这一教学实践在教育中日益普遍。在GAI辅助写作中，学生可将构思与成句等核心认知任务交由GAI完成，仍能产出高质量作文。这给教师评估与支持学习带来了新挑战：难以判断学生是否进行了有意义的认知活动，以及作文质量有多少归功于这些过程。本研究基于1,445个GAI辅助写作会话数据，采用先进的X-Learner方法，量化分析三种写作行为模式对四类作文质量指标（词汇复杂度、句法复杂度、文本连贯性、语言偏见）的因果影响：仅寻求建议但不采纳、直接采纳建议、采纳并修改建议。结果表明，频繁修改AI生成内容的学生，在词汇复杂度、句法复杂度和文本连贯性方面均有显著提升，反映出更高阶认知参与；而频繁直接采纳者则出现质量下降。此外，尽管独立写作的人类作者易引入语言偏见，但使用（即使不修改）GAI生成内容可有效缓解该问题。
原文摘要 · Abstract (English)
Students are increasingly relying on Generative AI (GAI) to support their writing-a key pedagogical practice in education. In GAI-assisted writing, students can delegate core cognitive tasks (e.g., generating ideas and turning them into sentences) to GAI while still producing high-quality essays. This creates new challenges for teachers in assessing and supporting student learning, as they often lack insight into whether students are engaging in meaningful cognitive processes during writing or how much of the essay's quality can be attributed to those processes. This study aimed to help teachers better assess and support student learning in GAI-assisted writing by examining how different writing behaviors, especially those indicative of meaningful learning versus those that are not, impact essay quality. Using a dataset of 1,445 GAI-assisted writing sessions, we applied the cutting-edge method, X-Learner, to quantify the causal impact of three GAI-assisted writing behavioral patterns (i.e., seeking suggestions but not accepting them, seeking suggestions and accepting them as they are, and seeking suggestions and accepting them with modification) on four measures of essay quality (i.e., lexical sophistication, syntactic complexity, text cohesion, and linguistic bias). Our analysis showed that writers who frequently modified GAI-generated text-suggesting active engagement in higher-order cognitive processes-consistently improved the quality of their essays in terms of lexical sophistication, syntactic complexity, and text cohesion. In contrast, those who often accepted GAI-generated text without changes, primarily engaging in lower-order processes, saw a decrease in essay quality. Additionally, while human writers tend to introduce linguistic bias when writing independently, incorporating GAI-generated text-even without modification-can help mitigate this bias.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。