arXiv:2607.11205cs.CV2026-07

利用双视角拍摄解决复杂人像抠图难题,无需特殊设备

Parallax Portrait Matting

论文配图:Parallax Portrait Matting
图 1 · 摘自论文原文
  • 用两张轻微位移的图像生成前景与背景运动信息
  • 在复杂纹理人像上实现更精细的边缘和更准的肤色还原
  • 适合手机端连拍场景,无需绿幕或特殊光照

图像抠图任务在前景和背景均纹理丰富时尤为困难。现有单图方法依赖数据先验,常在复杂情况下表现不佳。以往方法需额外信号如绿幕、偏振光或干净背景,但依赖特殊采集设备。本文提出帕拉克斯人像抠图(Parallax Portrait Matting),利用相机微小移动产生的双帧图像,自然形成前后景视差,提供互补信息。算法估计前景/背景运动并构建对齐视图,通过背景对齐图像直接融合,结合前景对齐的交叉注意力进行误差补偿。实验表明,该方法在挑战性人像场景中,相比强基线单图方法,能恢复更精细的细节和更准确的前景颜色。

原文摘要 · Abstract (English)

Image matting is highly ill-posed, especially when both the foreground and background are richly textured. While single-image matting methods learn strong priors from data, they often struggle on these challenging cases. Existing approaches improve results by requiring additional signals such as green screens, polarized lighting, or clean background images, but these typically rely on specialized capture setups. We present Parallax Portrait Matting, a practical two-frame matting method that uses a second image captured with slight viewpoint change. Such a setting arises naturally in burst photography, where small camera motion induces foreground-background parallax and provides complementary observations for matting. Our pipeline estimates trimaps and foreground/background motion, then constructs aligned views for prediction. To handle imperfect motion estimation, the network uses the background-aligned pair for direct fusion and the foreground-aligned cue through cross-attention for error compensation. Experiments show that our method recovers finer details and more accurate foreground colors than strong single-image matting baselines on challenging portrait cases.

图像抠图双视角人像处理深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。