arXiv:2605.07402cs.CV2026-05被引 1

让插入人物自然且保持原样,解决姿势错乱与身份丢失问题

InsHuman: Towards Natural and Identity-Preserving Human Insertion

论文配图:InsHuman: Towards Natural and Identity-Preserving Human Insertion
图 1 · 摘自论文原文
  • 用自适应融合对齐人体与背景,确保姿态和数量一致
  • 通过人脸特征匹配维持插入者身份不变,避免脸型变化
  • 构建新数据集,含真实人与背景互动,适合图像编辑研究

人体插入旨在将特定个体自然地融入目标背景。尽管现有图像编辑模型具备此能力,但常出现姿势不自然、人数不一致、面部身份改变等失败案例。公开的人体数据集普遍缺乏全身肖像及人与背景的真实交互。为此,我们提出InsHuman,实现自然且身份保留的人体插入。提出人体-背景自适应融合(HBAF),通过检测前景人体生成二值掩码,并采用区域感知加权对齐预测与真实潜在表示中的人体区域,确保姿态、人数和整体外观与目标背景协调适配。进一步提出人脸到人脸身份保持(FFIP),基于人脸识别特征在生成图像与源图像间检测并匹配人脸,强化每张人脸的身份一致性。此外,提出双向数据配对(BDP)策略,构建高质量数据集BDP-InsHuman,包含真实的人体与背景交互。实验表明,InsHuman在生成合理图像的同时,显著保持了人体身份不变。

原文摘要 · Abstract (English)

Human insertion aims to naturally place specific individuals into a target background. Although existing image editing models may have such ability, they often produce failure cases, including inappropriate human pose in new background, inconsistent number of people, and modified facial identity. Moreover, publicly available human datasets often lack full-body portraits and realistic physical interaction between humans and their background. To address these challenges, we propose InsHuman for natural and identity-preserving human insertion. Specifically, we propose Human-Background Adaptive Fusion (HBAF), which detects foreground humans to obtain a binary mask and applies region-aware weighting to align the human regions between predicted and ground-truth latents, ensuring the person's pose, count, and overall appearance are coherently adapted to the target background.We further propose Face-to-Face ID-Preserving (FFIP), which detects and matches faces between the generated image and the source image in terms of face recognition features to enforce identity consistency for each face.In addition, we propose Bidirectional Data Pairing (BDP) strategy to construct BDP-InsHuman, a high-quality dataset with realistic human-background interactions. Experiments demonstrate that InsHuman achieves significant improvements in generating plausible images while keeping human identity unchanged.

图像编辑身份保持人体插入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。