arXiv:2410.05530cs.CGcs.LG2024-10NeurIPS被引 2

用扩散模型通过符号距离函数生成多边形,解决可见性图重建难题。

VisDiff: SDF-Guided Polygon Generation for Visibility Reconstruction and Recognition

  • 先生成多边形的符号距离函数,再从中提取顶点位置。
  • 在可见性图重建任务上F1分数提升26%,优于现有方法。
  • 适合研究几何生成、组合结构建模的读者。

捕捉组合结构的丰富表征已推动机器学习在平面图、地形、图像和动画分析与生成中的应用。近期工作主要关注具有明确特征、邻域或距离度量的结构,而缺乏这些特性的结构仍鲜有研究。此类组合结构常见于多边形中,顶点位置的微小变化会导致可见性或三角剖分图的显著重组。现有表征学习方法难以捕捉无明确特征与度量的结构。本文研究开放问题:给定可见性图 $G$,重构一个其可见性图为 $G$ 的多边形 $P$。我们提出 VisDiff,一种基于扩散模型的新型多边形生成方法。核心创新在于不直接生成顶点集,而是先估计与多边形相关的符号距离函数(SDF),再利用 SDF 提取最终多边形的顶点位置。实验表明,通过 SDF 路径能更有效地学习可见性关系。为训练 VisDiff,我们构建了一个精心策划的数据集,并在此基础上进行基准测试,相比标准方法及最先进模型,实现 26% 的 F1-Score 提升。

原文摘要 · Abstract (English)

The ability to capture rich representations of combinatorial structures has enabled the application of machine learning to tasks such as analysis and generation of floorplans, terrains, images, and animations. Recent work has primarily focused on understanding structures with well-defined features, neighborhoods, or underlying distance metrics, while those lacking such characteristics remain largely unstudied. Examples of these combinatorial structures can be found in polygons, where a small change in the vertex locations causes a significant rearrangement of the combinatorial structure, expressed as a visibility or triangulation graphs. Current representation learning approaches fail to capture structures without well-defined features and distance metrics. In this paper, we study the open problem of Visibility Reconstruction: Given a visibility graph $G$, construct a polygon $P$ whose visibility graph is $G$. We introduce VisDiff, a novel diffusion-based approach to generate polygon $P$ from the input visibility graph $G$. The main novelty of our approach is that, rather than generating the polygon's vertex set directly, we first estimate the signed distance function (SDF) associated with the polygon. The SDF is then used to extract the vertex location representing the final polygon. We show that going through the SDF allows VisDiff to learn the visibility relationship much more effectively than generating vertex locations directly. In order to train VisDiff, we create a carefully curated dataset. We use this dataset to benchmark our method and achieve 26% improvement in F1-Score over standard methods as well as state of the art approaches.

几何生成扩散模型可见性图多边形重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。