研究AI写诗与人类诗歌的相似性,找出难以区分的关键特征。
Characterizing Human-Likeness in AI Generated Poetry: A Zero-shot Classification Study

- 用零样本方法分析人类与AI诗歌的差异特征
- 发现AI诗歌在多数情况下被误判为人类创作
- 为检测工具优化提供可解释的特征依据
随着生成式AI技术的发展,人工智能生成内容(GenAI)与人类写作文本已几乎无法区分。全球标准化的AI聊天机器人也导致学术不端行为增多。现有研究表明,未经修改的GenAI诗歌最难辨识,因此现代检测器常将其误判为人类作品。然而,这类结论的客观性仍需通过现代检测工具验证,而诗歌本身的主观性以及大语言模型(LLM)的黑箱特性使验证极为复杂。本研究旨在揭示影响英语诗歌分类与误分类的关键属性,并检验其可区分性的主张。为此,我们提出一种零样本检测流程,使用包含人类与AI诗歌的数据集,验证二者可区分性并提取关键特征。这些特征的提取具有双重价值:一方面可减少训练所需数据量,仅需对易混淆特征的诗歌进行微调;另一方面为生成式AI检测难题提供关键洞见,从而增强现代检测系统的可靠性。
原文摘要 · Abstract (English)
With the advancement of AI technologies, Generative AI (GenAI) and human written text have become nearly indistinguishable. Additionally, the global standardization of AI chatbots made academic malpractice more frequent. Furthermore, existing research indicates GenAI poems are the most difficult to distinguish even without any modification thus, GenAI poems are naturally deemed human-like by modern detectors. However, the objectivity of such dissertations needs to be verified against modern detection tools but the subjectivity of poetry and the black-box nature of the modern LLMs (Large Language Models) architectures made verification of such work quite complicated. Hence, the main objective of the research is to deduce the attributes of English poetry that contribute classification and misclassification of both human and AI poems and provide corroborating or contradicting evidence to the poetry distinguishability claim. For such characterizations, we propose a Zero-shot detection pipeline with a dataset consisting of both human and AI poems to verify the distinguishability of human and AI creation and extract the aforementioned crucial attributes for accurate classification. Extraction of such attributes provides benefits in two ways: firstly, it reduces the margin of training needed as only the poems based on misclassifying attributes need to be trained and fine tuned and finally provides a critical insight to the GenAI detection dilemma to strengthen the modern detection pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。