arXiv:2502.14005cs.LG2025-02IJCV被引 10

用15亿参数模型实现跨领域版面统一生成,效率超越更大模型。

Smaller But Better: Unifying Layout Generation with Smaller Large Language Models

  • 设计统一输入输出模板,支持多领域版面任务
  • 1.5B模型在复杂场景下超越7B、175B模型表现
  • 压缩编码保留关键布局信息,提升训练效率

我们提出LGGPT,一种专用于统一版面生成的大型语言模型。首先,引入任意版面指令(ALI)与通用版面响应(ULR)作为统一的输入输出模板,可适配多个版面领域的任意生成任务,实现此前未探索的任务通用与领域通用版面生成。ALI与ULR结构简洁,摒弃传统HTML格式中的冗余标记,提升指令微调效率并增强统一生成性能。此外,提出区间量化编码(IQE)策略,将ALI压缩为更紧凑结构,精准保留有效布局线索,消除低信息量占位符,助力LGGPT在统一训练中捕捉复杂多变的生成条件。实验表明,LGGPT在性能上优于或媲美现有方法。尤为突出的是,1.5B参数的小型模型在最广泛且挑战性最强的统一场景中,仍显著超越以往7B或175B模型。同时,我们验证了使用大模型进行统一版面生成的必要性,并通过对比不同规模模型,建议1.5B可能是最优参数量级。代码已开源:https://github.com/NiceRingNode/LGGPT。

原文摘要 · Abstract (English)

We propose LGGPT, an LLM-based model tailored for unified layout generation. First, we propose Arbitrary Layout Instruction (ALI) and Universal Layout Response (ULR) as the uniform I/O template. ALI accommodates arbitrary layout generation task inputs across multiple layout domains, enabling LGGPT to unify both task-generic and domain-generic layout generation hitherto unexplored. Collectively, ALI and ULR boast a succinct structure that forgoes superfluous tokens typically found in existing HTML-based formats, facilitating efficient instruction tuning and boosting unified generation performance. In addition, we propose an Interval Quantization Encoding (IQE) strategy that compresses ALI into a more condensed structure. IQE precisely preserves valid layout clues while eliminating the less informative placeholders, facilitating LGGPT to capture complex and variable layout generation conditions during the unified training process. Experimental results demonstrate that LGGPT achieves superior or on par performance compared to existing methods. Notably, LGGPT strikes a prominent balance between proficiency and efficiency with a compact 1.5B parameter LLM, which beats prior 7B or 175B models even in the most extensive and challenging unified scenario. Furthermore, we underscore the necessity of employing LLMs for unified layout generation and suggest that 1.5B could be an optimal parameter size by comparing LLMs of varying scales. Code is available at https://github.com/NiceRingNode/LGGPT.

版面生成小模型LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。