用推理链让大模型自动生成高质量版式,无需训练。
LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation
- 将版式转为可读格式,结合检索增强与思维链迭代优化。
- 五个数据集上零训练超越现有方法,媲美专用推理模型。
- 适合希望低成本实现智能排版的开发者与设计师。
条件化版式生成旨在根据用户约束自动生成视觉美观且语义一致的版式。尽管基于生成模型的近期方法已取得进展,但通常需要大量训练数据或繁复微调,限制了其灵活性与实用性。部分无训练方法虽借助大语言模型(LLM)的上下文学习能力,却受限于推理能力不足和过于简单的排序机制,难以持续生成高质量版式。为此,我们提出LayoutCoT,通过检索增强生成(RAG)与思维链(CoT)技术相结合,激发LLM的深层推理潜力。具体而言,布局表示被转化为适配LLM处理的标准序列格式;布局感知的RAG用于高效检索并生成粗略布局;该初步布局连同精选示例输入至专门设计的CoT推理模块进行迭代优化,显著提升语义连贯性与视觉质量。我们在涵盖三项任务的五个公开数据集上进行了广泛实验。结果表明,LayoutCoT在无需训练或微调的情况下达到当前最优性能。尤为关键的是,其CoT推理模块使标准LLM(即使不具备显式深度推理能力)表现优于专用深度推理模型如deepseek-R1,充分展现了本方法在释放大模型深层推理能力于版式生成中的巨大潜力。
原文摘要 · Abstract (English)
Conditional layout generation aims to automatically generate visually appealing and semantically coherent layouts from user-defined constraints. While recent methods based on generative models have shown promising results, they typically require substantial amounts of training data or extensive fine-tuning, limiting their versatility and practical applicability. Alternatively, some training-free approaches leveraging in-context learning with Large Language Models (LLMs) have emerged, but they often suffer from limited reasoning capabilities and overly simplistic ranking mechanisms, which restrict their ability to generate consistently high-quality layouts. To this end, we propose LayoutCoT, a novel approach that leverages the reasoning capabilities of LLMs through a combination of Retrieval-Augmented Generation (RAG) and Chain-of-Thought (CoT) techniques. Specifically, LayoutCoT transforms layout representations into a standardized serialized format suitable for processing by LLMs. A Layout-aware RAG is used to facilitate effective retrieval and generate a coarse layout by LLMs. This preliminary layout, together with the selected exemplars, is then fed into a specially designed CoT reasoning module for iterative refinement, significantly enhancing both semantic coherence and visual quality. We conduct extensive experiments on five public datasets spanning three conditional layout generation tasks. Experimental results demonstrate that LayoutCoT achieves state-of-the-art performance without requiring training or fine-tuning. Notably, our CoT reasoning module enables standard LLMs, even those without explicit deep reasoning abilities, to outperform specialized deep-reasoning models such as deepseek-R1, highlighting the potential of our approach in unleashing the deep reasoning capabilities of LLMs for layout generation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。