用可解释的诗歌形式特征,区分并引导AI写更像人的韩语现代诗。
Detecting and Guiding LLM-Generated Korean Poetry with Interpretable Form-level Features

- 设计五维可解释特征,量化人类与AI诗歌在体裁上的差异。
- 检测准确率比最强基线高7.76个AUC点,生成结果更接近人类风格。
- 适合研究AI创作、诗歌生成或语言形式分析的学者使用。
大型语言模型在生成现代韩语诗歌时常产出类似‘分行散文’的内容。本文解决两个关联任务:判断一首韩语诗是人类还是大模型所作,并指导大模型生成更贴近人类写作形式的作品。通过四个形式维度——篇幅(Volume)、句尾形式的多样性与连贯性(Structure Variation)、句长不规则性(Rhythmic Irregularity)以及标准拼写的遵守程度(Normative Adherence),构建五个可解释特征。基于这些特征的逻辑回归分类器,在七种未见大模型上实现83.60的平均AUC-ROC,优于最强基线KatFishNet的75.84,绝对提升7.76,相对提升10.23%;仅一个生成器特有的标点模式为边界案例。在生成方面,专家评估显示GPT-5.2更偏好特征引导的诗歌;对GPT-5.2和Gemini-3的分析表明,针对性调整长度、节奏与结尾统计量可使生成结果趋近人类分布。结果表明,可解释的语言特定特征能有效衔接诗歌的诊断与生成引导。
原文摘要 · Abstract (English)
LLMs often struggle with modern Korean poetry, producing outputs that resemble "line-broken prose." We address two coupled tasks: detecting whether a Korean poem is human- or LLM-authored, and guiding LLMs to generate poetry closer in form to human writing. We quantify the human-LLM gap along four form-level linguistic dimensions: output length (Volume), the diversity and connective use of line-final forms (Structure Variation), the irregularity of line lengths (Rhythmic Irregularity), and adherence to standard orthography (Normative Adherence). We operationalize these dimensions as five interpretable features. For detection, a logistic regression classifier over these five features attains an average AUC-ROC of 83.60 in zero-shot out-of-distribution detection across seven unseen LLMs, versus 75.84 for the strongest baseline in our comparison, KatFishNet, an absolute gain of 7.76 AUC points and a 10.23% relative improvement; one generator-specific punctuation pattern outside our taxonomy remains a boundary case. For generation, expert evaluation on GPT-5.2 prefers feature-guided poems over the unconstrained baseline, and analyses across GPT-5.2 and Gemini-3 show that targeted length, rhythm, and ending statistics move toward the human distribution. These results suggest that interpretable, language-specific features can bridge the diagnosis and guidance of LLM-generated poetry.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。