用半监督方法提升物体放置模型的泛化能力。
Object Placement for Anything
- 基于有标签数据学习合理性变化知识,迁移到无标签数据
- 在大规模未标注数据上训练,显著提升模型泛化性能
- 适合需要真实场景通用性的图像合成应用
物体放置旨在确定前景物体在背景图像上的合适位置和尺寸。以往方法受限于小规模带标签数据集,难以推广到真实场景。本文提出一种半监督框架,利用大规模未标注数据增强判别式物体放置模型的泛化能力。判别模型对给定的前景-背景组合预测合理性标签。为更好利用有标签数据,该框架进一步设计了合理性变化知识的迁移机制,即判断前景放置的变化是否导致合理性标签改变,并将此知识从有标签数据传递至无标签数据。大量实验表明,该框架能有效提升模型泛化能力。
原文摘要 · Abstract (English)
Object placement aims to determine the appropriate placement (\emph{e.g.}, location and size) of a foreground object when placing it on the background image. Most previous works are limited by small-scale labeled dataset, which hinders the real-world application of object placement. In this work, we devise a semi-supervised framework which can exploit large-scale unlabeled dataset to promote the generalization ability of discriminative object placement models. The discriminative models predict the rationality label for each foreground placement given a foreground-background pair. To better leverage the labeled data, under the semi-supervised framework, we further propose to transfer the knowledge of rationality variation, \emph{i.e.}, whether the change of foreground placement would result in the change of rationality label, from labeled data to unlabeled data. Extensive experiments demonstrate that our framework can effectively enhance the generalization ability of discriminative object placement models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。