构建首个大规模序列化人脸属性编辑数据集,助力细粒度图像篡改检测。
SEED: A Benchmark Dataset for Sequential Facial Attribute Editing with Diffusion Models
- 用扩散模型生成9万+张带多步修改痕迹的人脸图,标注每步属性变化。
- 提出频率感知模型FAITH,有效识别细微渐进式编辑痕迹。
- 适合研究图像溯源、深度伪造检测及生成模型鲁棒性方向的学者。
扩散模型近年来实现了对人脸多种语义属性的精确且逼真的单步编辑。然而,随着对逐步修改(如发型、妆容、配饰)序列追踪的需求增长,如何准确归因和检测连续编辑成为新挑战,且缺乏大规模、精细标注的数据集支持。本文提出SEED,一个基于先进扩散模型构建的大规模序列化人脸编辑数据集。SEED包含超过9万张人脸图像,每张图像包含1至4次连续属性修改,由多种扩散编辑流程(LEdits、SDXL、SD3)生成。每张图像均配有详细的编辑序列、属性掩码及提示词,可支持序列编辑追踪、视觉溯源分析与篡改鲁棒性评估研究。为评测该任务,我们提出基于频率感知的Transformer模型FAITH,通过引入高频特征增强对细微渐进变化的敏感性。大量实验表明,FAITH在多频域方法对比中表现优异,凸显了SEED带来的独特挑战。数据集与代码将公开发布于:https://github.com/Zeus1037/SEED。
原文摘要 · Abstract (English)
Diffusion models have recently enabled precise and photorealistic facial editing across a wide range of semantic attributes. Beyond single-step modifications, a growing class of applications now demands the ability to analyze and track sequences of progressive edits, such as stepwise changes to hair, makeup, or accessories. However, sequential editing introduces significant challenges in edit attribution and detection robustness, further complicated by the lack of large-scale, finely annotated benchmarks tailored explicitly for this task. We introduce SEED, a large-scale Sequentially Edited facE Dataset constructed via state-of-the-art diffusion models. SEED contains over 90,000 facial images with one to four sequential attribute modifications, generated using diverse diffusion-based editing pipelines (LEdits, SDXL, SD3). Each image is annotated with detailed edit sequences, attribute masks, and prompts, facilitating research on sequential edit tracking, visual provenance analysis, and manipulation robustness assessment. To benchmark this task, we propose FAITH, a frequency-aware transformer-based model that incorporates high-frequency cues to enhance sensitivity to subtle sequential changes. Comprehensive experiments, including systematic comparisons of multiple frequency-domain methods, demonstrate the effectiveness of FAITH and the unique challenges posed by SEED. SEED offers a challenging and flexible resource for studying progressive diffusion-based edits at scale. Dataset and code will be publicly released at: https://github.com/Zeus1037/SEED.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。