arXiv:2502.01411cs.CV2025-02ICML被引 5

提出一键扩散模型与新数据集,提升人体修复质量

Human Body Restoration with One-Step Diffusion Model and A New Benchmark

  • 用自动筛选流水线构建高质量人体修复数据集
  • 新模型在视觉效果和指标上均优于现有方法
  • 适合图像修复、生成模型研究者参考

人体修复作为图像修复的特定应用,在多个领域具有重要价值。然而,由于缺乏基准数据集,相关研究进展受限。本文提出一种高质图像自动裁剪与过滤(HQ-ACF)流水线,利用现有目标检测数据集及未标注图像,自动提取并筛选高质量人体图像。基于此,构建了包含复杂物体与自然动作的面向人物修复的数据集(PERSONA),涵盖训练、验证与测试集,其质量和内容丰富度显著优于现有同类数据集。最后,提出一种新型的一步扩散模型OSDHuman,设计高保真图像嵌入器(HFIE)作为提示生成器,有效利用低质量人体图像信息,避免误导性提示。实验表明,OSDHuman在视觉质量与定量指标上均优于现有方法。数据集与代码已开源。

原文摘要 · Abstract (English)

Human body restoration, as a specific application of image restoration, is widely applied in practice and plays a vital role across diverse fields. However, thorough research remains difficult, particularly due to the lack of benchmark datasets. In this study, we propose a high-quality dataset automated cropping and filtering (HQ-ACF) pipeline. This pipeline leverages existing object detection datasets and other unlabeled images to automatically crop and filter high-quality human images. Using this pipeline, we constructed a person-based restoration with sophisticated objects and natural activities (\emph{PERSONA}) dataset, which includes training, validation, and test sets. The dataset significantly surpasses other human-related datasets in both quality and content richness. Finally, we propose \emph{OSDHuman}, a novel one-step diffusion model for human body restoration. Specifically, we propose a high-fidelity image embedder (HFIE) as the prompt generator to better guide the model with low-quality human image information, effectively avoiding misleading prompts. Experimental results show that OSDHuman outperforms existing methods in both visual quality and quantitative metrics. The dataset and code will at https://github.com/gobunu/OSDHuman.

人体修复扩散模型数据集构建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。