用深度特征自动计算网格变形权重,实时且保持视觉一致性。
Deep Feature Deformation Weights
- 基于深度特征相似性生成平滑的变形权重,无需额外正则化。
- 支持百万面网格实时处理,速度比传统方法快数倍。
- 可自动检测对称性并保持变形对称性,适合动画与建模场景。
基于手柄的网格变形是计算机图形学中的经典范式,允许用户通过稀疏控制实现直观编辑。传统方法快速精准,但需预先知晓理想手柄位置,难以直观且不易调整;现代数据驱动方法虽能实现语义级编辑,却牺牲了细粒度控制与速度。本文提出一种新方法,结合两者优势:利用深度特征相似性生成平滑、视觉感知的变形权重,无需额外正则化。关键在于权重可实时计算任意表面点,而无需昂贵优化。我们引入重心特征蒸馏(barycentric feature distillation),利用形状渲染的完整视觉信号,使蒸馏过程对网格分辨率不敏感,从而将高分辨率网格处理时间从数小时缩短至数分钟。通过特征空间约束与局部加权,保留并扩展了经典性质。该场表示支持自动视觉对称性检测,并用于生成保持对称性的变形。我们展示了首个概念验证应用,可在消费级机器上实时处理高达100万面的网格。
原文摘要 · Abstract (English)
Handle-based mesh deformation is a classic paradigm in computer graphics which enables intuitive edits from sparse controls. Classical techniques are fast and precise, but require users to know ideal handle placement apriori, which can be unintuitive and inconsistent. Handle sets cannot be adjusted easily, as weights are typically optimized through energies defined by the handles. Modern data-driven methods, on the other hand, provide semantic edits but sacrifice fine-grained control and speed. We propose a technique that achieves the best of both worlds: deep feature proximity yields smooth, visual-aware deformation weights with no additional regularization. Importantly, these weights are computed in real-time for any surface point, unlike prior methods which require expensive optimization. We introduce barycentric feature distillation, an improved feature distillation pipeline which leverages the full visual signal from shape renders to make distillation complexity robust to mesh resolution. This enables high resolution meshes to be processed in minutes versus potentially hours for prior methods. We preserve and extend classical properties through feature space constraints and locality weighting. Our field representation enables automatic visual symmetry detection, which we use to produce symmetry-preserving deformations. We show a proof-of-concept application which can produce deformations for meshes up to 1 million faces in real-time on a consumer-grade machine. Project page at https://threedle.github.io/dfd.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。