指出使用AI写作时认知负担积累的研究存在方法缺陷
Comment on: Your Brain on ChatGPT: Accumulation of Cognitive Debt When Using an AI Assistant for Essay Writing Tasks
- 批评原研究设计样本小、分析可复现性差
- 质疑脑电分析方法与结果报告的一致性
- 建议提升研究透明度以增强可信度
Kosmyna 等人（2025）关于使用 AI 助手进行作文任务时认知债务积累的研究引发了关于人工智能与人类表现关系的重要讨论。本文对其研究表示祝贺，认可其在数据收集和自然语言处理自动化分析流程方面的贡献。但同时提出若干建设性意见：研究设计存在样本量有限的问题；分析过程的可复现性不足；脑电分析方法存在方法学问题；结果报告存在不一致之处；研究程序与发现的透明度有待提高。建议对相关结果采取更保守的解读，并加强研究透明度以提升论文发表可行性。
原文摘要 · Abstract (English)
Recently published work titled Your Brain on ChatGPT: Accumulation of Cognitive Debt When Using an AI Assistant for Essay Writing Task by Kosmyna et al. (2025) has sparked a vivid debate on the topic of artificial intelligence (AI) and human performance. We sincerely congratulate Kosmyna et al. for initiating such important research, collecting a valuable dataset, and establishing highly automated pipelines for Natural Language Processing (NLP) analyses and scoring. We aim to provide constructive comments that may improve the manuscript's readiness for peer-reviewed publication, as some results by Kosmyna et al. (2025) could be interpreted more conservatively. Our primary concerns focus on: (i) study design considerations, including the limited sample size; (ii) the reproducibility of the analyses; (iii) methodological issues related to the EEG analysis; (iv) inconsistencies in the reporting of results; and (v) limited transparency in several aspects of the study's procedures and findings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。