arXiv:2601.14056cs.CVcs.AI2026-01被引 2

用3D布局指导生成可控的合成监控数据,提升场景一致性与编辑灵活性。

POCI-Diff: 3D-Layout Guided Diffusion for Controllable Synthetic Surveillance Data Generation

  • 基于3D框布局和文本描述,单次前向传播生成多物体场景。
  • 在多个视角下保持几何一致性,消除传统方法的形变伪影。
  • 支持无重映射编辑,适合需要高保真数据增强的视觉监控研究。

训练鲁棒的视觉监控模型需要大规模且带有精确空间标注的数据集,但真实监控数据的采集成本高、涉及隐私问题,且常受法律限制。合成数据生成提供了一种有吸引力的替代方案,但现有方法缺乏对物体位置和外观的细粒度3D控制,导致不同摄像头视角间的几何不一致。本文提出POCI-Diff(Positioning Objects Consistently and Interactively),一种从显式3D边界框布局生成带标注合成场景的框架,支持每个物体的语义控制。通过融合混合潜在扩散模型与深度条件控制网,POCI-Diff可在单次前向传播中合成复杂多物体场景,并将特定文本描述绑定至3D位置。进一步提出无重映射编辑流程,支持通过再生实现物体插入、删除与变换,提升数据增强效率。通过IP-Adapter引入参考图像,确保编辑过程中物体身份一致,外观稳定。实验表明,POCI-Diff在视觉保真度与布局遵循度上优于现有最先进3D布局引导生成方法,同时彻底消除形变引起的几何伪影。

原文摘要 · Abstract (English)

Training robust visual surveillance models requires large-scale datasets with precise spatial annotations, yet collecting real surveillance data is costly, privacy-sensitive, and often legally constrained. Synthetic data generation offers a compelling alternative, but existing methods lack fine-grained 3D control over object placement and appearance, limiting geometric consistency across camera viewpoints. We introduce POCI-Diff (Positioning Objects Consistently and Interactively), a framework that generates annotated synthetic scenes from explicit 3D bounding-box layouts with per-object semantic control. By integrating Blended Latent Diffusion with depth-conditioned ControlNet, POCI-Diff synthesises complex multi-object scenes in a single forward pass, binding individual text descriptions to specific 3D locations. We further propose a warping-free editing pipeline supporting object insertion, removal, and transformation via regeneration, enabling efficient scene variation for data augmentation. Object identity across edits is preserved by conditioning on reference images via IP-Adapter, ensuring appearance consistency throughout interactive scene manipulation. Experiments show that POCI-Diff outperforms state-of-the-art 3D layout-guided generation methods in visual fidelity and layout adherence, while eliminating warping-induced geometric artifacts.

3D生成合成数据监控系统扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。