arXiv:2608.27927cs.SEcs.AI2026-08

梳理AI辅助定性分析中的陷阱,助科研者避免低质研究。

Antipatterns in AI-assisted Qualitative Data Analysis: A Catalog of Temptations and Pitfalls for Software Engineering Researchers

  • 总结三类反模式:危险驱动、操作失误、分析失败
  • 揭示看似高效实则损害研究严谨性的常见做法
  • 适合想用AI做定性研究的软件工程学者参考

AI辅助定性数据分析(QDA)为软件工程(SE)研究提供了前所未有的效率提升机会,但若缺乏审慎使用,可能削弱分析严谨性,导致低质量研究泛滥。本文基于多年定性SE研究经验与对AI-QDA发展态势的理解,提出一份反模式目录,包含三类逐步加剧危害的错误假设与实践:危险驱动、操作失误和分析失败。这些反模式虽初看有利,实则损害研究有效性。该目录可帮助研究人员识别并规避常见陷阱,同时为评审人提供判断标准,推动负责任的人机协作在定性研究中的健康发展。

原文摘要 · Abstract (English)

AI-assisted qualitative data analysis (QDA) offers unprecedented opportunities to streamline software engineering (SE) research, yet uncritical use risks compromising analytical rigor and flooding the field with accelerated production of low-quality research. While tactical best practices will naturally evolve over time, SE researchers currently lack strategic guidance to identify and mitigate methodological risks when attempting AI-assisted QDA. Based on our decades of qualitative SE research expertise and experience combined with an understanding of the emerging landscape of AI-assisted QDA, this paper presents a catalog of antipatterns in AI-assisted QDA - a set of assumptions and practices that initially appear advantageous but ultimately undermine analytical rigor and validity. The antipatterns are grouped into three categories reflecting escalating impact: Dangerous Drivers, Operational Missteps, and Analytical Failures. As more SE researchers attempt AI-assisted QDA, these antipatterns will help them identify and avoid common temptations and pitfalls, while reviewers can be equipped with the vocabulary and criteria to call out problematic and failed practice. Ultimately, this catalog of antipatterns can serve as a stepping stone in our responsible methodological evolution toward principled and meaningful human-AI collaboration in qualitative research.

定性分析AI陷阱研究方法软件工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。