arXiv:2602.04167cs.CV2026-02被引 2

仅用少量点即可精准插入物体,无需繁琐画框。

Point2Insert: Video Object Insertion via Sparse Point Guidance

  • 用正负点控制物体位置,替代费时的涂色掩码
  • 分两阶段训练,结合去物模型合成数据增强效果
  • 小模型性能超大模型,适合快速编辑视频

本文提出Point2Insert,一种基于稀疏点的视频物体插入框架,旨在实现高效、灵活的物体放置。现有方法面临两大挑战:基于掩码的方法需大量手工标注,基于指令的方法难以精确定位。Point2Insert仅需少量稀疏点(正/负点)即可指示合适或不合适插入区域,实现细粒度空间控制。训练分为两个阶段:第一阶段训练一个条件生成模型,根据稀疏点提示或二值掩码生成物体;第二阶段利用物体移除模型合成配对视频,进一步微调模型以适应视频插入任务。此外,借鉴掩码引导编辑更高的成功率,采用掩码引导模型作为教师,通过知识蒸馏将可靠插入行为迁移至点引导模型。大量实验表明,Point2Insert持续优于强基线,甚至超越参数量×10更大的模型。

原文摘要 · Abstract (English)

This paper introduces Point2Insert, a sparse-point-based framework for flexible and user-friendly object insertion in videos, motivated by the growing popularity of accurate, low-effort object placement. Existing approaches face two major challenges: mask-based insertion methods require labor-intensive mask annotations, while instruction-based methods struggle to place objects at precise locations. Point2Insert addresses these issues by requiring only a small number of sparse points instead of dense masks, eliminating the need for tedious mask drawing. Specifically, it supports both positive and negative points to indicate regions that are suitable or unsuitable for insertion, enabling fine-grained spatial control over object locations. The training of Point2Insert consists of two stages. In Stage 1, we train an insertion model that generates objects in given regions conditioned on either sparse-point prompts or a binary mask. In Stage 2, we further train the model on paired videos synthesized by an object removal model, adapting it to video insertion. Moreover, motivated by the higher insertion success rate of mask-guided editing, we leverage a mask-guided insertion model as a teacher to distill reliable insertion behavior into the point-guided model. Extensive experiments demonstrate that Point2Insert consistently outperforms strong baselines and even surpasses models with $\times$10 more parameters.

视频编辑点引导物体插入少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。