首个可凸优化的隐式神经体表示,训练更快更稳。
Geometric Algebra Planes: Convex Implicit Neural Volumes
- 用张量基+神经解码器构建可凸优化的隐式体积模型
- 2D下比经典低秩+稀疏分解更优,3D任务性能媲美主流方法
- 适合需要稳定训练的逆问题场景,如三维重建与视频分割
体素参数化在近期文献中层出不穷,从经典的体素网格到隐式神经表示及其间各种形式。尽管隐式表示相比体素网格展现出更强的表达能力与更高的内存效率,但至今仍需通过非凸优化进行训练。这种非凸训练过程收敛慢,对初始化和超参数敏感,影响最终结果。我们提出一类新模型GA-Planes,是首个可通过凸优化训练的隐式神经体积表示。GA-Planes包含任意组合的张量基元素特征,后接神经特征解码器,可泛化多种现有表示,并可根据不同逆问题需求灵活适配凸、半凸或非凸训练。在2D情况下,我们证明GA-Planes等价于低秩加低分辨率矩阵分解;实验表明该近似在拟合自然图像时优于经典低秩加稀疏分解。在3D中,我们在辐射场重建、3D分割和视频分割三个体积拟合任务上展示了其在表达能力、模型规模和可优化性方面的竞争力。
原文摘要 · Abstract (English)
Volume parameterizations abound in recent literature, from the classic voxel grid to the implicit neural representation and everything in between. While implicit representations have shown impressive capacity and better memory efficiency compared to voxel grids, to date they require training via nonconvex optimization. This nonconvex training process can be slow to converge and sensitive to initialization and hyperparameter choices that affect the final converged result. We introduce a family of models, GA-Planes, that is the first class of implicit neural volume representations that can be trained by convex optimization. GA-Planes models include any combination of features stored in tensor basis elements, followed by a neural feature decoder. They generalize many existing representations and can be adapted for convex, semiconvex, or nonconvex training as needed for different inverse problems. In the 2D setting, we prove that GA-Planes is equivalent to a low-rank plus low-resolution matrix factorization; we show that this approximation outperforms the classic low-rank plus sparse decomposition for fitting a natural image. In 3D, we demonstrate GA-Planes' competitive performance in terms of expressiveness, model size, and optimizability across three volume fitting tasks: radiance field reconstruction, 3D segmentation, and video segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。