让扩散模型按数值精细调节图像美感强度,支持多属性连续控制。
AttriCtrl: Fine-Grained Control of Aesthetic Attribute Intensity in Diffusion Models
- 用统一0到1尺度量化抽象与具体美感属性,实现连续值输入
- 通过轻量适配器使模型在不训练主干的情况下精确控制美感程度
- 适合需要个性化、高精度美学调整的创作场景
扩散模型已成为图像生成的主流范式,但现有系统难以理解并执行对语义属性的数值指令。在真实创作场景中,当需要精确控制美学属性时,当前方法缺乏可控性。这不仅源于审美判断的主观性和上下文依赖性,更根本的原因在于现有文本编码器针对离散标记设计,而非连续值。尽管美学对齐研究(如强化学习、偏好优化或结构修改)提升了整体用户满意度,却忽视了美学的多维度与可组合性,亟需显式解耦并独立控制各美学属性。为此,我们提出AttriCtrl,一种用于扩散模型中连续美学强度控制的轻量级框架。该框架首先定义相关美学属性,再通过混合策略将具体与抽象维度映射到统一的[0,1]区间。引入即插即用的值编码器,将用户指定数值转换为模型可理解的嵌入向量以实现可控生成。实验表明,AttriCtrl能准确实现单个及多个美学属性的连续控制,显著提升个性化与多样性。关键在于其作为轻量适配器实现,冻结扩散模型主干,与ControlNet等现有框架无缝集成,计算开销极低。
原文摘要 · Abstract (English)
Diffusion models have recently become the dominant paradigm for image generation, yet existing systems struggle to interpret and follow numeric instructions for adjusting semantic attributes. In real-world creative scenarios, especially when precise control over aesthetic attributes is required, current methods fail to provide such controllability. This limitation partly arises from the subjective and context-dependent nature of aesthetic judgments, but more fundamentally stems from the fact that current text encoders are designed for discrete tokens rather than continuous values. Meanwhile, efforts on aesthetic alignment, often leveraging reinforcement learning, direct preference optimization, or architectural modifications, primarily align models with a global notion of human preference. While these approaches improve user experience, they overlook the multifaceted and compositional nature of aesthetics, underscoring the need for explicit disentanglement and independent control of aesthetic attributes. To address this gap, we introduce AttriCtrl, a lightweight framework for continuous aesthetic intensity control in diffusion models. It first defines relevant aesthetic attributes, then quantifies them through a hybrid strategy that maps both concrete and abstract dimensions onto a unified $[0,1]$ scale. A plug-and-play value encoder is then used to transform user-specified values into model-interpretable embeddings for controllable generation. Experiments show that AttriCtrl achieves accurate and continuous control over both single and multiple aesthetic attributes, significantly enhancing personalization and diversity. Crucially, it is implemented as a lightweight adapter while keeping the diffusion model frozen, ensuring seamless integration with existing frameworks such as ControlNet at negligible computational cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。