用神经隐式表示生成可编辑的文本转矢量图,支持动态调整。
NeuralSVG: An Implicit Representation for Text-to-Vector Generation

- 用小规模MLP隐式编码整个画面,通过SDS优化生成。
- 引入丢弃正则化,使每层图形独立有意义,提升结构质量。
- 单个模型支持推理时交互调整,适合设计工具集成。
矢量图形在设计中至关重要,能生成分辨率无关且高度可编辑的内容。近年来,视觉-语言与扩散模型的发展推动了文本到矢量图形生成的研究。但现有方法常产生参数过载的输出,或将分层结构这一核心特征视为次要目标,限制了实用性。针对分层SVG表示的重要性,我们提出NeuralSVG,一种从文本提示生成矢量图形的隐式神经表示。受NeRF启发,NeuralSVG将整个场景编码为小型MLP网络的权重,通过得分蒸馏采样(SDS)优化。为促进生成的SVG具备分层结构,我们引入基于丢弃的正则化技术,强化每个形状的独立语义。此外,我们证明神经表示可在推理时提供控制能力,用户仅需单一学习到的表示即可动态调整生成结果。通过大量定性和定量评估,验证了NeuralSVG在生成结构化、灵活的SVG方面优于现有方法。
原文摘要 · Abstract (English)
Vector graphics are essential in design, providing artists with a versatile medium for creating resolution-independent and highly editable visual content. Recent advancements in vision-language and diffusion models have fueled interest in text-to-vector graphics generation. However, existing approaches often suffer from over-parameterized outputs or treat the layered structure - a core feature of vector graphics - as a secondary goal, diminishing their practical use. Recognizing the importance of layered SVG representations, we propose NeuralSVG, an implicit neural representation for generating vector graphics from text prompts. Inspired by Neural Radiance Fields (NeRFs), NeuralSVG encodes the entire scene into the weights of a small MLP network, optimized using Score Distillation Sampling (SDS). To encourage a layered structure in the generated SVG, we introduce a dropout-based regularization technique that strengthens the standalone meaning of each shape. We additionally demonstrate that utilizing a neural representation provides an added benefit of inference-time control, enabling users to dynamically adapt the generated SVG based on user-provided inputs, all with a single learned representation. Through extensive qualitative and quantitative evaluations, we demonstrate that NeuralSVG outperforms existing methods in generating structured and flexible SVG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。