arXiv:2604.23540cs.CV2026-04被引 1

通过球面约束优化噪声,快速实现文本图像精准对齐。

Oracle Noise: Faster Semantic Spherical Alignment for Interpretable Latent Optimization

论文配图:Oracle Noise: Faster Semantic Spherical Alignment for Interpretable Latent Optimization
图 1 · 摘自论文原文
  • 在球面上更新噪声,保持原始分布不被破坏。
  • 2秒内完成优化,显著提升对齐度与图像质量。
  • 无需外部模型,适合需要快速生成的场景。

文本到图像扩散模型虽具备强大生成能力,但精确对齐复杂文本提示与合成布局仍是挑战。初始高斯噪声作为关键结构种子,决定宏观布局。现有在线优化方法依赖无约束的欧氏梯度上升,数学上会放大潜在范数,破坏标准高斯先验,导致严重视觉伪影(如色彩过饱和)。同时存在语义路由效率低、易陷入外部代理模型的“奖励劫持”陷阱。为此,我们提出 Oracle Noise,一种零样本框架,将噪声初始化重构为严格限制在黎曼超球面上的语义驱动优化。不依赖复杂外部解析器,直接识别提示中最具影响力的结构词,高效分配优化能量。通过沿球面路径更新噪声,数学上保持原高斯分布。该几何约束消除范数膨胀,支持激进步长实现快速收敛。大量实验表明,Oracle Noise 显著加速语义对齐,且在无黑箱模型情况下达到最优美学表现。完全消除欧氏诱导的退化,在人类偏好指标(如 HPSv2、ImageReward)、语义对齐(CLIP Score)和样本多样性上均达当前最优,全部控制在 2 秒优化预算内。

原文摘要 · Abstract (English)

Text-to-image diffusion models have achieved remarkable generative capabilities, yet accurately aligning complex textual prompts with synthesized layouts remains an ongoing challenge. In these models, the initial Gaussian noise acts as a critical structural seed dictating the macroscopic layout. Recent online optimization and search methods attempt to refine this noise to enhance text-image alignment. However, relying on unconstrained Euclidean gradient ascent mathematically inflates the latent norm and destroys the standard Gaussian prior, causing severe visual artifacts like color over-saturation. Furthermore, these methods suffer from inefficient semantic routing and easily fall into the ``reward hacking'' trap of external proxy models. To address these intertwined bottlenecks, we propose Oracle Noise, a zero-shot framework reframing noise initialization as semantic-driven optimization strictly confined to a Riemannian hypersphere. Instead of relying on complex external parsers, we directly identify the most impactful structural words in the prompt to efficiently route optimization energy. By updating the noise strictly along a spherical path, we mathematically preserve the original Gaussian distribution. This geometric constraint eliminates norm inflation and unlocks aggressive step sizes for rapid convergence. Extensive experiments demonstrate that Oracle Noise significantly accelerates semantic alignment and achieves superior aesthetics without black-box models. It completely mitigates Euclidean-induced degradation, establishing state-of-the-art performance across human preference metrics (e.g., HPSv2, ImageReward), semantic alignment (CLIP Score), and sample diversity, all within a strict 2-second optimization budget.

扩散模型语义对齐优化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。