arXiv:2502.04369cs.CVcs.LG2025-02CVPR被引 6

提出新型全局风格注入模块,提升任意风格迁移的全局一致性与效率

HSI: A Holistic Style Injector for Arbitrary Style Transfer

  • 基于全局风格表征而非局部匹配进行风格迁移
  • 采用元素乘法实现线性复杂度,计算效率显著提升
  • 适合需要高效高保真风格迁移的应用场景

基于注意力机制的任意风格迁移方法虽能生成丰富风格细节,但其逐点匹配易忽视风格图像的全局特征,且在处理大图时因注意力机制的二次复杂度导致计算负担重。为此,本文提出全局风格注入模块(HSI),仅依赖全局风格表征进行风格化,避免生成局部不协调图案。HSI内设双关系学习机制,通过内容与风格间的语义相似性动态渲染图像,保障原内容不变的同时提升风格保真度。由于采用元素乘法建立特征映射,该方法实现线性计算复杂度。定性与定量结果均表明,本方法在效果与效率上均优于现有先进方法。

原文摘要 · Abstract (English)

Attention-based arbitrary style transfer methods have gained significant attention recently due to their impressive ability to synthesize style details. However, the point-wise matching within the attention mechanism may overly focus on local patterns such that neglect the remarkable global features of style images. Additionally, when processing large images, the quadratic complexity of the attention mechanism will bring high computational load. To alleviate above problems, we propose Holistic Style Injector (HSI), a novel attention-style transformation module to deliver artistic expression of target style. Specifically, HSI performs stylization only based on global style representation that is more in line with the characteristics of style transfer, to avoid generating local disharmonious patterns in stylized images. Moreover, we propose a dual relation learning mechanism inside the HSI to dynamically render images by leveraging semantic similarity in content and style, ensuring the stylized images preserve the original content and improve style fidelity. Note that the proposed HSI achieves linear computational complexity because it establishes feature mapping through element-wise multiplication rather than matrix multiplication. Qualitative and quantitative results demonstrate that our method outperforms state-of-the-art approaches in both effectiveness and efficiency.

风格迁移注意力机制高效算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。