arXiv:2608.15583cs.CV2026-08

用轻量框架实现复杂多物体图像的精准姿态控制生成。

PoseAdapter: Dual-Stream 2.5D Controllable Image Generation for Complex Multi-Object Scenes

论文配图:PoseAdapter: Dual-Stream 2.5D Controllable Image Generation for Complex Multi-Object Scenes
图 1 · 摘自论文原文
  • 用对象描述+2D框+3D角度构建空间方位锚点,替代昂贵3D地图。
  • 双流结构分离局部与全局特征,提升生成精度与场景连贯性。
  • 适合需要精确布局控制的图像生成任务,如设计、影视制作。

尽管文本到图像扩散模型已取得显著进展,但在多物体场景中实现精确的空间与方向控制仍是长期挑战。现有方法要么依赖计算成本高的密集3D地图,要么存在严重属性泄露和“拼接”伪影。为此,我们提出PoseAdapter,一种轻量级高保真2.5D可控图像生成框架。不采用密集空间图,而是通过高效条件布局——单个对象描述、2D边界框和3D角度——建立精确的空间-角度锚点。为解决严格实例隔离与全局一致性之间的权衡,引入上下文感知的双流表示:通过并行掩码与非掩码路径,将局部对象标记与关系丰富场景标记注入现代多模态迪特(MM-DiT)架构的视觉流中,消除属性泄露,同时保留自然的物体间关系与场景整体连贯性。为支持该范式,构建了OrientLayout数据集,包含标准化2.5D标注和实例级解耦语义。大量实验表明,PoseAdapter在空间精度、方向精度和多物体视觉保真度上均优于当前最优基线。代码与数据集将发布于https://github.com/cyf23/PoseAdapter。

原文摘要 · Abstract (English)

While Text-to-Image (T2I) diffusion models have achieved remarkable success, precise spatial and orientational control in multi-object scenes remains a persistent challenge. Existing methods either rely on computationally expensive dense 3D maps or suffer from severe attribute leakage and "cut-and-paste" artifacts. To address these limitations, we propose PoseAdapter, a lightweight framework for high-fidelity 2.5D controllable image generation. Instead of dense spatial maps, it establishes precise spatial-angular anchors using an efficient condition layout: individual object captions, 2D bounding boxes, and 3D angles. To resolve the generative trade-off between strict instance isolation and global coherence, we introduce a Context-Aware Dual-Stream Representation. By injecting local object tokens and relation-enriched scene tokens into the visual stream of modern MM-DiT architectures via parallel masked and unmasked pathways, PoseAdapter eliminates attribute leakage while preserving natural inter-object relationships and scene-level coherence. To support this paradigm, we construct OrientLayout, a high-quality dataset featuring standardized 2.5D annotations and instance-level decoupled semantics. Extensive experiments demonstrate that PoseAdapter outperforms state-of-the-art baselines in spatial accuracy, orientational precision, and multi-object visual fidelity. Code and dataset will be available at https://github.com/cyf23/PoseAdapter.

图像生成可控生成2.5D控制多物体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。