用逻辑约束提升视觉语言模型解数独的准确性
MaxSAT-Based Feedback for Guiding Vision-Language Models in Sudoku
- 将数独规则转为硬约束,用MaxSAT验证并修正模型生成答案
- 使解题正确率提升,在完整填表模式下效果更明显
- 适合需要高逻辑可靠性的视觉推理任务研究者
视觉-语言模型(VLMs)在结构化视觉推理任务中表现优异,但在数独等网格类谜题中常因缺乏显式逻辑约束而产生矛盾解答。本文提出一种神经符号方法,通过最大可满足性(MaxSAT)求解器作为一致性校验与优化引擎,将VLM生成的候选答案编码为软约束,保留数独规则为硬约束。当发现矛盾时,MaxSAT求解器识别最大一致子集,并转化为结构化文本与视觉反馈,指导模型迭代修正。在多个开源与闭源VLM上测试显示,该方法显著提升逻辑一致性,增加成功解题数量,尤其在全盘修正模式下表现突出。结果表明,符号优化可有效增强视觉语言模型的推理可靠性。
原文摘要 · Abstract (English)
Vision--Language Models (VLMs) have recently demonstrated promising performance on structured visual reasoning tasks, including grid-based puzzles. However, despite strong perceptual capabilities, these models lack explicit mechanisms for enforcing logical consistency and frequently generate assignments that violate underlying constraints. In this paper, we propose a neuro-symbolic approach that integrates formal constraint reasoning into the VLM solving process via a Maximum Satisfiability (MaxSAT) oracle. Rather than computing solutions directly, the symbolic component acts as a consistency validator and refinement engine. Candidate placements generated by the VLM are encoded as soft clauses in a partial MaxSAT formulation, while Sudoku constraints remain hard clauses. When inconsistencies arise, the MaxSAT solver identifies a largest mutually consistent subset of assignments, which is then translated into structured textual and visual feedback to guide subsequent refinements. We evaluate our approach on a Sudoku dataset across multiple open-source and closed-access VLMs. Results show that MaxSAT-based feedback improves logical consistency and increases the number of solved instances, particularly in full-board refinement mode. These findings demonstrate that symbolic optimisation can enhance the reliability of vision-language reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。