arXiv:2509.18538cs.CV2025-09NeurIPS被引 10

通过几何感知框架,精准移除物体及其阴影反射等视觉因果效应。

GeoRemover: Removing Objects and Their Causal Visual Artifacts

  • 分两阶段:先删几何结构,再基于新几何渲染真实图像。
  • 在两个基准上实现物体与因果效应同步移除的最好效果。
  • 适合需要高精度图像编辑的科研与设计人员使用。

为实现智能图像编辑,物体移除需同时清除目标物体及其因果视觉效应(如阴影、反光)。现有基于图像外观的方法或严格依赖掩码对齐训练,无法处理未显式标注的因果效应;或采用松散掩码对齐策略,缺乏可控性且可能过度擦除其他物体。我们发现这些局限源于忽略物体几何存在与其视觉效果间的因果关系。为此,提出几何感知的两阶段框架,将物体移除解耦为(1)几何移除和(2)外观渲染。第一阶段在几何空间(如深度图)中直接移除物体,采用严格掩码对齐监督,实现结构感知编辑并强约束几何一致性。第二阶段基于更新后的几何信息条件化生成逼真RGB图像,因果视觉效应作为三维几何变化的隐含结果自然重建。为引导几何移除阶段学习,引入基于正负样本对的偏好驱动目标,促使模型有效移除物体及其因果效应,同时避免新增结构。大量实验表明,本方法在两个主流基准上均达到当前最优性能。代码已开源于 https://github.com/buxiangzhiren/GeoRemover。

原文摘要 · Abstract (English)

Towards intelligent image editing, object removal should eliminate both the target object and its causal visual artifacts, such as shadows and reflections. However, existing image appearance-based methods either follow strictly mask-aligned training and fail to remove these causal effects which are not explicitly masked, or adopt loosely mask-aligned strategies that lack controllability and may unintentionally over-erase other objects. We identify that these limitations stem from ignoring the causal relationship between an object's geometry presence and its visual effects. To address this limitation, we propose a geometry-aware two-stage framework that decouples object removal into (1) geometry removal and (2) appearance rendering. In the first stage, we remove the object directly from the geometry (e.g., depth) using strictly mask-aligned supervision, enabling structure-aware editing with strong geometric constraints. In the second stage, we render a photorealistic RGB image conditioned on the updated geometry, where causal visual effects are considered implicitly as a result of the modified 3D geometry. To guide learning in the geometry removal stage, we introduce a preference-driven objective based on positive and negative sample pairs, encouraging the model to remove objects as well as their causal visual artifacts while avoiding new structural insertions. Extensive experiments demonstrate that our method achieves state-of-the-art performance in removing both objects and their associated artifacts on two popular benchmarks. The code is available at https://github.com/buxiangzhiren/GeoRemover.

图像编辑几何感知因果效应去物修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。