arXiv:2608.20932cs.CV2026-08

只需添加序号即可控制物体遮挡顺序的图像生成方法

OccluRank: Controllable Occlusion-Aware Layout-to-Image Generation by Adding Just an Ordinal Rank

论文配图:OccluRank: Controllable Occlusion-Aware Layout-to-Image Generation by Adding Just an Ordinal Rank
图 1 · 摘自论文原文
  • 用序号标记代替复杂几何条件,实现遮挡顺序控制
  • 在合成数据集上生成更准确的遮挡关系和布局
  • 适合需要精确空间布局与遮挡控制的应用场景

布局到图像生成通过边界框实现空间控制,但边界框无法表达物体间的遮挡顺序。现有方法依赖额外几何条件、复杂推理或独立构建实例表示,缺乏对遮挡依赖交互的显式建模。本文提出OccluRank,仅在每个边界框中增加一个序号,通过轻量级秩条件编码用户指定的遮挡顺序,并引入有序实例交互(OII)模块,在聚合前联合更新受秩条件约束的实例表示。该设计使指定顺序引导遮挡实例间的信息交换,无需额外几何输入或特殊推理优化。此外,构建了合成训练数据集OccluLayout,其遮挡顺序与非可视区域标注直接来自已知场景几何,而非通过辅助模型从部分遮挡图像中估计。为全面评估,提出OccluLayout-Bench,结合多模态大语言模型评估器,评测实例存在性、空间布局、属性及遮挡顺序,并使用FID评估整体图像质量。实验表明,OccluRank能更可靠地保留目标实例,遵循指定布局,并实现期望的遮挡关系,同时保持相近的属性一致性和图像质量。

原文摘要 · Abstract (English)

Layout-to-image generation enables explicit spatial control through bounding-box layouts, yet bounding boxes specify only instance locations and cannot represent their occlusion order. Existing methods may rely on additional geometric conditions, employ complex inference procedures, or aggregate independently constructed instance representations without explicitly modeling their occlusion-dependent interactions. We propose OccluRank, a simple and controllable occlusion-aware layout-to-image framework that augments each bounding box with only one ordinal rank. OccluRank encodes the user-specified occlusion order through lightweight rank-based conditioning and introduces an Order-aware Instance Interaction (OII) module to jointly update rank-conditioned instance representations before aggregation. This allows the specified order to guide information exchange among occluding instances without additional geometric inputs or specialized inference-time optimization. We further construct OccluLayout, a synthetic training dataset whose occlusion order and amodal annotations are derived directly from known scene geometry rather than estimated from partially occluded images using auxiliary prediction models. For comprehensive evaluation, we introduce OccluLayout-Bench, which uses multiple multimodal large language model evaluators to assess instance presence, spatial layout, attributes, and occlusion order, together with FID for overall image quality. Experiments show that OccluRank more reliably preserves target instances, follows specified layouts, and realizes desired occlusion relationships while maintaining comparable attribute consistency and overall image quality.

布局生成遮挡控制图像生成序号条件

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。