arXiv:2508.02374cs.CVcs.IR2025-08中稿 · ACM MM 2025被引 15

统一布局生成与人类反馈评估,让AI设计更贴近真实审美。

Uni-Layout: Integrating Human Feedback in Unified Layout Generation and Evaluation

  • 用自然语言统一处理多种布局任务,支持背景与元素约束。
  • 构建10万张专家标注的布局数据集,实现拟人化评估。
  • 动态调整偏好边界,使生成与评价更符合人类判断。

布局生成在提升用户体验和设计效率方面至关重要。然而,现有方法存在任务专用性、评估指标与感知不匹配的问题,导致应用受限且度量无效。本文提出 extit{Uni-Layout},实现统一生成、拟人化评估及两者对齐。通过将多种布局任务纳入同一分类体系,开发统一生成器,仅依赖自然语言提示即可处理含背景或元素约束的任务。为引入人类反馈,构建首个大规模人类反馈数据集 extit{Layout-HF100k}(10万张专家标注布局)。基于此,设计一个融合视觉与几何信息的拟人化评估器,采用思维链机制进行定性分析,并配备置信度估计模块输出定量结果。为加强生成与评估的对齐,引入动态边界偏好优化(DMPO),根据偏好强度动态调整边际,更贴近人类判断。大量实验表明, extit{Uni-Layout}显著优于任务特定及通用方法。代码已开源于https://github.com/JD-GenX/Uni-Layout。

原文摘要 · Abstract (English)

Layout generation plays a crucial role in enhancing both user experience and design efficiency. However, current approaches suffer from task-specific generation capabilities and perceptually misaligned evaluation metrics, leading to limited applicability and ineffective measurement. In this paper, we propose \textit{Uni-Layout}, a novel framework that achieves unified generation, human-mimicking evaluation and alignment between the two. For universal generation, we incorporate various layout tasks into a single taxonomy and develop a unified generator that handles background or element contents constrained tasks via natural language prompts. To introduce human feedback for the effective evaluation of layouts, we build \textit{Layout-HF100k}, the first large-scale human feedback dataset with 100,000 expertly annotated layouts. Based on \textit{Layout-HF100k}, we introduce a human-mimicking evaluator that integrates visual and geometric information, employing a Chain-of-Thought mechanism to conduct qualitative assessments alongside a confidence estimation module to yield quantitative measurements. For better alignment between the generator and the evaluator, we integrate them into a cohesive system by adopting Dynamic-Margin Preference Optimization (DMPO), which dynamically adjusts margins based on preference strength to better align with human judgments. Extensive experiments show that \textit{Uni-Layout} significantly outperforms both task-specific and general-purpose methods. Our code is publicly available at https://github.com/JD-GenX/Uni-Layout.

布局生成人类反馈评估对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。