用混合方法提升古希腊诗韵律检测与生成,准确率超70%。
LLMs Got Rhythm? Hybrid Phonological Filtering for Greek Poetry Rhyme Detection and Generation
- 结合语言模型与规则算法,系统识别五类希腊诗韵模式。
- 引入语音验证循环后,诗歌生成准确率达73.1%。
- 适合研究低资源语言韵律、跨模态诗歌生成的学者使用。
大型语言模型(LLMs)在音位相关任务如押韵检测与生成上表现不佳,尤其在资源较少的语言中更为明显。本文提出一种混合系统,融合LLMs与确定性音位算法,实现对希腊语押韵的精准识别与生成。该方法构建了包含纯押韵、丰富押韵、不完美押韵、拼贴式押韵及相同前韵元音(IDV)在内的完整押韵类型分类体系,并采用带有音位验证的智能生成流水线。在多个模型(包括Claude 3.7、4.5,GPT-4o,Gemini 2.0,Llama 3.1 8B/70B和Mistral Large)上测试不同提示策略(零样本、少样本、思维链、RAG增强),结果表明:尽管原生模型(Claude 3.7)表现直觉化(识别准确率40%),但推理型模型(Claude 4.5)仅在使用思维链提示时达到最佳性能(54%)。最关键的是,纯LLM生成失败严重(有效诗作不足4%),而通过混合验证环路恢复至73.1%。我们发布该系统及由Anemoskala和战间期诗歌语料库构建的4万+押韵数据集,以支持后续研究。
原文摘要 · Abstract (English)
Large Language Models (LLMs), despite their remarkable capabilities across NLP tasks, struggle with phonologically-grounded phenomena like rhyme detection and generation. This is even more evident in lower-resource languages such as Modern Greek. In this paper, we present a hybrid system that combines LLMs with deterministic phonological algorithms to achieve accurate rhyme identification/analysis and generation. Our approach implements a comprehensive taxonomy of Greek rhyme types, including Pure, Rich, Imperfect, Mosaic, and Identical Pre-rhyme Vowel (IDV) patterns, and employs an agentic generation pipeline with phonological verification. We evaluate multiple prompting strategies (zero-shot, few-shot, Chain-of-Thought, and RAG-augmented) across several LLMs including Claude 3.7 and 4.5, GPT-4o, Gemini 2.0 and open-weight models like Llama 3.1 8B and 70B and Mistral Large. Results reveal a significant "Reasoning Gap": while native-like models (Claude 3.7) perform intuitively (40\% accuracy in identification), reasoning-heavy models (Claude 4.5) achieve state-of-the-art performance (54\%) only when prompted with Chain-of-Thought. Most critically, pure LLM generation fails catastrophically (under 4\% valid poems), while our hybrid verification loop restores performance to 73.1\%. We release our system and a corpus of 40,000+ rhymes, derived from the Anemoskala and Interwar Poetry corpora, to support future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。