无需参考图即可改写图像中人物与物体的互动关系。
Reference-free Human-Object Interaction Editing
- 分解场景为人物、物体和背景,解耦复杂交互关系。
- 新方法在交互编辑与身份保留间取得更好平衡。
- 适合研究图像编辑、人物物体关系建模的学者使用。
本文提出InteractEdit框架,实现无需参考图像的人-物交互(HOI)编辑,将图像中已有的交互转换为期望的新交互,同时保持主体与客体的身份一致。不同于属性修改、物体替换或风格迁移等任务,HOI编辑涉及复杂的空间、上下文及关系依赖。现有方法常过度拟合源图像结构,难以适应新交互所需的显著结构变化。为此,InteractEdit将场景拆分为主体、物体和背景三部分,解耦复杂交互关系,并引入选择性反演策略与选择性排序自适应(SeRA),利用预训练的交互先验知识,同时从源图像学习视觉身份,实现交互编辑与身份保留之间的良好权衡。我们还构建了IEBench新基准与联合评估指标,综合衡量交互编辑成功度与身份保留程度。大量实验表明,InteractEdit优于23种现有方法,为未来HOI编辑研究提供强基线。代码与数据集:https://jiuntian.github.io/InteractEdit/
原文摘要 · Abstract (English)
This paper presents InteractEdit, a novel framework for reference-free Human-Object Interaction (HOI) editing that tackles the challenging task of transforming an existing interaction in an image into a new, desired interaction while preserving the identities of the subject and object. Unlike prior image editing tasks such as attribute manipulation, object replacement or style transfer, HOI editing involves complex spatial, contextual, and relational dependencies inherent in HOI. Existing methods often overfit to the source image structure, limiting adaptability to the substantial structural modifications demanded by the new interactions. To address this, InteractEdit disassembles each scene into subject, object, and background components to disentangle intricate HOI relationship, and introduces a selective inversion strategy combined with Selective-Rank Adaptation (SeRA) to leverage pretrained interaction priors while learning visual identity from the source image. This enables a balanced trade-off between interaction editing and identity preservation. We also introduce IEBench, a new benchmark for HOI editing, and a new metric that jointly evaluates the trade-off between successful interaction editing and identity preservation. Extensive experiments show that InteractEdit outperforms 23 existing methods, providing a strong baseline for future HOI editing research. Code and the dataset: https://jiuntian.github.io/InteractEdit/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。