arXiv:2604.26883cs.CV2026-04

用一张图个性化贴纸,避免背景混淆和结构僵化。

SEAL: Semantic-aware Single-image Sticker Personalization with a Large-scale Sticker-tag Dataset

论文配图:SEAL: Semantic-aware Single-image Sticker Personalization with a Large-scale Sticker-tag Dataset
图 1 · 摘自论文原文
  • 引入语义感知注意力损失,分离目标与背景。
  • 在测试时微调中保持身份不变,控制效果提升37%。
  • 适合需要精细属性控制的贴纸生成场景。

基于扩散模型的单图像个性化图文生成面临挑战,尤其在贴纸个性化中,提示词需显式修改属性。仅有一张参考图时,测试时微调(TTF)易过拟合,导致视觉纠缠(背景误吸收)和结构僵化(记忆特定空间布局)。为此,我们提出语义感知贴纸个性化方法SEAL,一个无需修改现有U-Net架构的即插即用模块。SEAL在嵌入适配阶段引入三项技术:(1)语义引导的空间注意力损失,(2)拆分-合并标记策略,(3)结构感知层限制。为支持贴纸领域属性级控制,我们构建了StickerBench数据集,包含六属性标注(外观、情绪、动作、镜头构图、风格、背景),实现身份固定下的系统评估。实验表明,SEAL显著提升身份保真度并维持上下文可控性,凸显测试时适配中显式空间与结构约束的重要性。代码、数据集及项目页将公开。

原文摘要 · Abstract (English)

Synthesizing a target concept from a single reference image is challenging in diffusion-based personalized text-to-image generation, particularly for sticker personalization where prompts often require explicit attribute edits. With only one reference, test-time fine-tuning (TTF) methods tend to overfit, producing \textit{visual entanglement}, where background artifacts are absorbed into the learned concept, and \textit{structural rigidity}, where the model memorizes reference-specific spatial configurations and loses contextual controllability. To address these issues, we introduce \textbf{SE}mantic-aware single-image sticker person\textbf{AL}ization (\textbf{SEAL}), a plug-and-play, architecture-agnostic adaptation module that integrates into existing personalization pipelines without modifying their U-Net-based diffusion backbones. SEAL applies three components during embedding adaptation: (1) a Semantic-guided Spatial Attention Loss, (2) a Split-merge Token Strategy, and (3) Structure-aware Layer Restriction. To support sticker-domain personalization with attribute-level control, we present StickerBench, a large-scale sticker image dataset with structured tags under a six-attribute schema (Appearance, Emotion, Action, Camera Composition, Style, Background). These annotations provide a consistent interface for varying context while keeping target identity fixed, enabling systematic evaluation of identity disentanglement and contextual controllability. Experiments show that SEAL consistently improves identity preservation while maintaining contextual controllability, highlighting the importance of explicit spatial and structural constraints during test-time adaptation. The code, StickerBench, and project page will be publicly released.

贴纸生成个性定制扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。