让点云配准的损失函数变凸,提升迭代优化稳定性。
Deep Loss Convexification for Learning Iterative Models
- 用神经网络重构损失曲面,在真值附近实现局部凸化。
- 引入星凸性约束,使优化路径避开鞍点,逼近最优解。
- 适用于点云配准、图像对齐等需要稳定迭代的任务。
迭代方法如点云配准中的ICP常因非凸优化陷入局部最优(如鞍点)。本文提出深度损失凸化(DLC),利用神经网络过参数化特性,在测试时将损失景观重塑为以真值为中心的局部凸状。通过对抗训练操纵真值预测而非输入数据,采用星凸性(star-convexity)作为几何约束——即所有通过全局最小值的直线均为单峰。该方法生成两类新铰链损失并获得近最优预测。在训练循环神经网络、3D点云配准及多模态图像对齐任务中,DLC均取得当前最佳性能。
原文摘要 · Abstract (English)
Iterative methods such as iterative closest point (ICP) for point cloud registration often suffer from bad local optimality (e.g. saddle points), due to the nature of nonconvex optimization. To address this fundamental challenge, in this paper we propose learning to form the loss landscape of a deep iterative method w.r.t. predictions at test time into a convex-like shape locally around each ground truth given data, namely Deep Loss Convexification (DLC), thanks to the overparametrization in neural networks. To this end, we formulate our learning objective based on adversarial training by manipulating the ground-truth predictions, rather than input data. In particular, we propose using star-convexity, a family of structured nonconvex functions that are unimodal on all lines that pass through a global minimizer, as our geometric constraint for reshaping loss landscapes, leading to (1) extra novel hinge losses appended to the original loss and (2) near-optimal predictions. We demonstrate the state-of-the-art performance using DLC with existing network architectures for the tasks of training recurrent neural networks (RNNs), 3D point cloud registration, and multimodel image alignment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。