用大模型推理破解字谜填字题,解法可解释且性能领先。
A Reasoning-Based Approach to Cryptic Crossword Clue Solving
- 通过假设答案、生成词义游戏解释、验证推理步骤三步解题
- 在英国《泰晤士报》和《每日电讯报》的Cryptonite数据集上达新纪录
- 所有解法以Python代码呈现,推理过程可逐行审查
字谜填字题是语言挑战任务,全球主流报纸每日发布新题。每个字谜线索包含答案定义(如普通填字题)与'文字游戏'部分,后者使人类解题者无需依赖交叉线索即可确认答案正确性。本文构建了一个基于大模型的开源推理系统,通过(i)假设答案;(ii)提出文字游戏解释;(iii)使用基于编码推理步骤的验证器进行判断。该系统在英国《泰晤士报》与《每日电讯报》的Cryptonite数据集上达到新最优性能。由于所有解答以Python形式表达,经证明的答案具备可解释的文字游戏推理链,可供逐行检视。
原文摘要 · Abstract (English)
Cryptic crossword clues are challenging language tasks for which new test sets are released daily by major newspapers on a global basis. Each cryptic clue contains both the definition of the answer to be placed in the crossword grid (in common with regular crosswords), and 'wordplay' that proves that the answer is correct (i.e. a human solver can be confident that an answer is correct without needing crossing words as confirmation). This work describes an LLM-based reasoning system built from open-licensed components that solves cryptic clues by (i) hypothesising answers; (ii) proposing wordplay explanations; and (iii) using a verifier system that operates on codified reasoning steps. Overall, this system establishes a new state-of-the-art performance on the challenging Cryptonite dataset of clues from The Times and The Telegraph newspapers in the UK. Because each proved solution is expressed in Python, interpretable wordplay reasoning for proven answers is available for inspection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。