让检测模型按设计顺序逐层识别图形元素,提升准确率。
Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detection
- 按图层顺序逐个解构元素,利用底层信息辅助上层检测。
- 在1000万张设计图上训练,达到人类水平的完整框预测性能。
- 提出细粒度优化方法,适用于需精确布局理解的任务。
图形设计(如海报、广告、信息图)是传递信息的重要媒介,其由具有明确层级顺序的元素构成。现有目标检测模型将其视为无序集合,未利用这种结构。为此,我们提出DAD模型,将图形检测建模为组合性解构过程:按图层顺序解码元素,并利用下层元素辅助上层检测。核心在于全幅检测(amodal detection),可预测被遮挡部分的完整边界框。基于此,我们提出元素相对策略优化(EleRPO),将序列级监督扩展至元素级优化,提供细粒度训练信号,揭示每个元素对整体检测质量的贡献。该方法与层级顺序协同作用,显著提升性能。我们构建了包含1000万张图像的数据集用于训练与评估。实验表明,DAD超越所有基线,在全幅检测中达到人类水平,支持有效的图像到图层分解;EleRPO在九个检测基准上持续优于GRPO。
原文摘要 · Abstract (English)
Graphic designs, such as posters, advertisements, and infographics, are an important medium for communicating information and shaping understanding. Unlike natural images, they consist of layered elements with explicit compositional order. However, existing object detection models treat these elements as an unordered set, leaving compositional order unexploited. To address this limitation, we present Detect Anything in Graphic Design (DAD), a model that formulates graphic design detection as compositional deconstruction. It decodes elements in compositional order, using lower-layer elements to better detect higher-layer ones. The key feature of DAD is amodal detection, which predicts the full bounding box of each element, including regions occluded by elements placed above it. Building on this formulation, we propose Element Relative Policy Optimization (EleRPO), which extends GRPO from sequence-level supervision to element-level optimization. EleRPO provides fine-grained training signals that capture how each detected element contributes to overall detection quality, and works synergistically with compositional order to improve detection performance. To support training and evaluation, we build a dataset of 10 million graphic designs. Experiments show that DAD outperforms all baselines and achieves human-level performance in amodal detection, supporting effective image-to-layer decomposition. EleRPO consistently improves over GRPO across nine detection benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。