用拉普拉斯金字塔实现中式绘画风格迁移,保留细节更自然
Multiscale style transfer based on a Laplacian pyramid for traditional Chinese painting
- 分尺度处理:低分辨率传整体构图,高分辨率渐进增强细节
- 引入边缘选择模块,精准传递中式画作的抽象线条与平涂色彩
- 适合想生成高质量中式艺术风格图像的研究者和创作者
风格迁移可生成既保留内容图像结构又融合风格图像特征的美观图像。现有方法多以西方油画为风格源,直接用于传统中国绘画时会产生不自然的杂乱效果,因中式绘画以平涂色块和抽象对象为主。且多数方法仅在原始图像尺度下工作,忽略多尺度信息。本文提出一种基于拉普拉斯金字塔的多尺度风格迁移方法,通过在不同尺度学习图像特征,有效迁移中式绘画的独特模式。第一阶段使用风格迁移基础网络在低分辨率上传递整体构图;第二阶段通过带边缘信息选择(EIS)模块的细节增强网络,在高分辨率逐步强化内容与风格的细节。实验表明,该方法生成了高质量、视觉吸引人的风格化结果,并优于多种先进方法。代码与数据集见https://github.com/toby-katakuri/LP_StyleTransferNet。
原文摘要 · Abstract (English)
Style transfer is adopted to synthesize appealing stylized images that preserve the structure of a content image but carry the pattern of a style image. Many recently proposed style transfer methods use only western oil paintings as style images to achieve image stylization. As a result, unnatural messy artistic effects are produced in stylized images when using these methods to directly transfer the patterns of traditional Chinese paintings, which are composed of plain colors and abstract objects. Moreover, most of them work only at the original image scale and thus ignore multiscale image information during training. In this paper, we present a novel effective multiscale style transfer method based on Laplacian pyramid decomposition and reconstruction, which can transfer unique patterns of Chinese paintings by learning different image features at different scales. In the first stage, the holistic patterns are transferred at low resolution by adopting a Style Transfer Base Network. Then, the details of the content and style are gradually enhanced at higher resolutions by a Detail Enhancement Network with an edge information selection (EIS) module in the second stage. The effectiveness of our method is demonstrated through the generation of appealing high-quality stylization results and a comparison with some state-of-the-art style transfer methods. Datasets and codes are available at https://github.com/toby-katakuri/LP_StyleTransferNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。