arXiv:2510.04290cs.CV2025-10被引 25

将图像编辑转为视频生成,让修改更符合物理规律。

ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulation

  • 把输入和编辑图当视频首尾帧,用视频模型保持运动一致性。
  • 推理时引入思维标记,生成合理编辑轨迹,提升物理合理性。
  • 适合需要真实物理变化的图像编辑与世界模拟任务。

大型生成模型在图像编辑和上下文图像生成方面取得显著进展,但在确保物体物理一致性方面仍存在关键缺陷,这对世界模拟类任务尤为重要。本文提出ChronoEdit框架,将图像编辑重新定义为视频生成问题。首先,ChronoEdit将输入图像和编辑后图像视为视频的首帧和末帧,利用预训练的视频生成模型捕捉对象外观及隐含的运动与交互物理规律。其次,引入时间推理阶段,在推理时对目标帧与推理标记联合去噪,想象出合理的编辑轨迹,从而约束解空间至物理可行范围。推理标记在几步后被丢弃,避免全视频渲染带来的高计算开销。为验证效果,我们构建了PBench-Edit基准数据集,包含需物理一致性的图像-提示对,结果表明ChronoEdit在视觉保真度和物理合理性上均优于现有最优基线。

原文摘要 · Abstract (English)

Recent advances in large generative models have greatly enhanced both image editing and in-context image generation, yet a critical gap remains in ensuring physical consistency, where edited objects must remain coherent. This capability is especially vital for world simulation related tasks. In this paper, we present ChronoEdit, a framework that reframes image editing as a video generation problem. First, ChronoEdit treats the input and edited images as the first and last frames of a video, allowing it to leverage large pretrained video generative models that capture not only object appearance but also the implicit physics of motion and interaction through learned temporal consistency. Second, ChronoEdit introduces a temporal reasoning stage that explicitly performs editing at inference time. Under this setting, target frame is jointly denoised with reasoning tokens to imagine a plausible editing trajectory that constrains the solution space to physically viable transformations. The reasoning tokens are then dropped after a few steps to avoid the high computational cost of rendering a full video. To validate ChronoEdit, we introduce PBench-Edit, a new benchmark of image-prompt pairs for contexts that require physical consistency, and demonstrate that ChronoEdit surpasses state-of-the-art baselines in both visual fidelity and physical plausibility. Project page for code and models: https://research.nvidia.com/labs/toronto-ai/chronoedit

图像编辑时间推理物理一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。