复现DragDiffusion,验证其点控图像编辑的有效性与敏感参数
Reproducing DragDiffusion: Interactive Point-Based Editing with Diffusion Models
- 通过优化中间时刻扩散潜变量实现精准点控编辑
- 性能对时间步和特征层级敏感,其他组件容错范围广
- 多时间步优化不增效却显著增加计算开销
DragDiffusion是一种基于扩散模型的交互式点控图像编辑方法,允许用户通过拖动选定点来操控图像。该方法声称通过优化单个中间时间步的扩散潜变量,结合保持身份的微调和空间正则化,可实现精确的空间控制。本文使用作者发布的代码和DragBench基准进行可复现性研究,复现了原论文中的主要消融实验,包括扩散时间步选择、基于LoRA的微调、掩码正则化强度以及UNet特征监督,并观察到与原文报告的定性和定量趋势高度一致。同时,实验表明性能对少数超参数假设敏感,尤其是优化的时间步和用于运动监督的特征层级,而其他组件具有更宽泛的操作范围。我们进一步评估了多时间步潜变量优化变体,发现其并未提升空间精度,反而大幅增加计算成本。总体而言,我们的结果支持DragDiffusion的核心主张,同时明确了其可稳定复现的条件。代码已公开于https://github.com/AliSubhan5341/DragDiffusion-TMLR-Reproducibility-Challenge。
原文摘要 · Abstract (English)
DragDiffusion is a diffusion-based method for interactive point-based image editing that enables users to manipulate images by directly dragging selected points. The method claims that accurate spatial control can be achieved by optimizing a single diffusion latent at an intermediate timestep, together with identity-preserving fine-tuning and spatial regularization. This work presents a reproducibility study of DragDiffusion using the authors' released implementation and the DragBench benchmark. We reproduce the main ablation studies on diffusion timestep selection, LoRA-based fine-tuning, mask regularization strength, and UNet feature supervision, and observe close agreement with the qualitative and quantitative trends reported in the original work. At the same time, our experiments show that performance is sensitive to a small number of hyperparameter assumptions, particularly the optimized timestep and the feature level used for motion supervision, while other components admit broader operating ranges. We further evaluate a multi-timestep latent optimization variant and find that it does not improve spatial accuracy while substantially increasing computational cost. Overall, our findings support the central claims of DragDiffusion while clarifying the conditions under which they are reliably reproducible. Code is available at https://github.com/AliSubhan5341/DragDiffusion-TMLR-Reproducibility-Challenge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。