让3D场景像梵高画作一样变形,用笔触流动引导几何结构重塑。
Thinking Like Van Gogh: Structure-Aware Style Transfer via Flow-Guided 3D Gaussian Splatting
- 从2D画作提取笔触方向流场,反向作用于3D点云形成贴合结构的笔触
- 分离明暗与结构优化,避免剧烈抽象时产生伪影
- 用视觉大模型评估艺术真实性,超越传统像素比对
1888年,文森特·梵高写道:‘我追求本质的夸张。’这一理念强调强化结构形态而弱化照片级细节,正是后印象派艺术的核心。然而,现有3D风格迁移方法往往颠倒此原则,将几何视为表面纹理的刚性载体。为真实再现后印象派风格,几何抽象应成为表达主载体。本文提出一种基于流场引导的3D高斯泼溅几何迁移框架,在无需网格先验的条件下,通过提取2D绘画中的方向流场并回传至3D空间,调整高斯原语以形成顺应场景拓扑的流线型笔触。该方法实现由绘画运动直接驱动的结构性变形,而非依赖光度约束。主要贡献包括:(1) 一种基于投影的无网格流场引导机制,将2D艺术运动映射至3D高斯几何;(2) 明亮度-结构解耦策略,分离几何形变与颜色优化,缓解激进结构抽象带来的伪影;(3) 基于视觉语言模型的评估框架(VLM-as-a-Judge),通过美学判断替代传统像素级指标,明确回应艺术风格化的主观性。
原文摘要 · Abstract (English)
In 1888, Vincent van Gogh wrote, "I am seeking exaggeration in the essential." This principle, amplifying structural form while suppressing photographic detail, lies at the core of Post-Impressionist art. However, most existing 3D style transfer methods invert this philosophy, treating geometry as a rigid substrate for surface-level texture projection. To authentically reproduce Post-Impressionist stylization, geometric abstraction must be embraced as the primary vehicle of expression. We propose a flow-guided geometric advection framework for 3D Gaussian Splatting (3DGS) that operationalizes this principle in a mesh-free setting. Our method extracts directional flow fields from 2D paintings and back-propagates them into 3D space, rectifying Gaussian primitives to form flow-aligned brushstrokes that conform to scene topology without relying on explicit mesh priors. This enables expressive structural deformation driven directly by painterly motion rather than photometric constraints. Our contributions are threefold: (1) a projection-based, mesh-free flow guidance mechanism that transfers 2D artistic motion into 3D Gaussian geometry; (2) a luminance-structure decoupling strategy that isolates geometric deformation from color optimization, mitigating artifacts during aggressive structural abstraction; and (3) a VLM-as-a-Judge evaluation framework that assesses artistic authenticity through aesthetic judgment instead of conventional pixel-level metrics, explicitly addressing the subjective nature of artistic stylization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。