arXiv:2507.05568cs.CVcs.LG2025-07被引 3

用关系推理提升视觉布局生成的结构与多样性

ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models

  • 引入显式空间关系定义,拆解布局为可递归的结构单元
  • 通过原型重采样解决生成风格单一问题,提升多样性
  • 生成结果更符合人类审美,且过程更具可解释性

内容感知布局旨在合理安排设计元素以有效传达信息。近期趋势是利用大语言模型(LLM)自动生成布局,取得显著成果。然而,现有基于LLM的方法未能充分理解视觉主题与设计元素间的空间关系,导致布局在结构和多样性上存在缺陷。为此,我们提出ReLayout,一种基于关系思维链(relation-CoT)的新方法,从设计概念出发生成更合理且美学一致的布局。具体而言,我们通过引入区域、显著性、元素间距等显式关系定义,将布局分解为更小、结构化且可递归的子布局,从而实现更有序的生成。此外,基于这些关系,我们设计了布局原型重采样器,从三个维度量化布局原型特征,缓解因原型分布偏差导致的生成同质化问题。大量实验表明,ReLayout优于基线方法,能生成结构更严谨、风格更多样、更贴近人类审美的布局,且具备更强可解释性。

原文摘要 · Abstract (English)

Content-aware layout aims to arrange design elements appropriately on a given canvas to convey information effectively. Recently, the trend for this task has been to leverage large language models (LLMs) to generate layouts automatically, achieving remarkable performance. However, existing LLM-based methods fail to adequately interpret spatial relationships among visual themes and design elements, leading to structural and diverse problems in layout generation. To address this issue, we introduce ReLayout, a novel method that leverages relation-CoT to generate more reasonable and aesthetically coherent layouts by fundamentally originating from design concepts. Specifically, we enhance layout annotations by introducing explicit relation definitions, such as region, salient, and margin between elements, with the goal of decomposing the layout into smaller, structured, and recursive layouts, thereby enabling the generation of more structured layouts. Furthermore, based on these defined relationships, we introduce a layout prototype rebalance sampler, which defines layout prototype features across three dimensions and quantifies distinct layout styles. This sampler addresses uniformity issues in generation that arise from data bias in the prototype distribution balance process. Extensive experimental results verify that ReLayout outperforms baselines and can generate structural and diverse layouts that are more aligned with human aesthetics and more explainable.

布局生成关系推理多模态大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。