arXiv:2502.01356cs.CV2025-02

提出可学习的共形卷积,让深度学习在曲面数据上更精准

Quasi-Conformal Convolution : A Learnable Convolution for Deep Learning on Simply Connected Open Surfaces

  • 基于拟共形理论设计可学习卷积,通过映射动态调整操作
  • 在曲面图像分类任务中性能优于传统方法,准确率显著提升
  • 适合处理3D人脸、颅面等几何数据,医学应用潜力大

非欧几里得域上的深度学习对分析缺乏统一坐标系和欧氏性质的复杂几何数据至关重要。核心挑战在于如何在具有不规则非欧结构的域上定义卷积。本文提出拟共形卷积(QCC),一种基于拟共形理论在单连通开曲面上定义卷积的新框架。每个QCC算子关联一个特定的拟共形映射,可通过调节该映射来调整卷积操作。通过可训练的估计模块生成拟共形映射,实现自适应且可学习的卷积算子,能根据曲面数据结构动态调整。QCC统一了多种空间定义的卷积,支持针对每类曲面学习定制化卷积算子,以优化特定任务。基于此,我们构建了拟共形卷积神经网络(QCCNN),用于解决几何数据相关任务。在曲面图像分类任务中验证了其有效性,表现优异。此外,探索其在医学领域的应用,包括基于3D人脸数据的颅面分析和3D人脸病变分割,均实现更高精度与可靠性。

原文摘要 · Abstract (English)

Deep learning on non-Euclidean domains is important for analyzing complex geometric data that lacks common coordinate systems and familiar Euclidean properties. A central challenge in this field is to define convolution on domains, which inherently possess irregular and non-Euclidean structures. In this work, we introduce Quasi-conformal Convolution (QCC), a novel framework for defining convolution on simply-connected open surfaces using quasi-conformal theories. Each QCC operator is linked to a specific quasi-conformal mapping, enabling the adjustment of the convolution operation through manipulation of this mapping. By utilizing trainable estimator modules that produce quasi-conformal mappings, QCC facilitates adaptive and learnable convolution operators that can be dynamically adjusted according to the underlying data structured on the surfaces. QCC unifies a broad range of spatially defined convolutions, facilitating the learning of tailored convolution operators on each underlying surface optimized for specific tasks. Building on this foundation, we develop the Quasi-Conformal Convolutional Neural Network (QCCNN) to address a variety of tasks related to geometric data. We validate the efficacy of QCCNN through the classification of images defined on curvilinear simply-connected open Riemann surfaces, demonstrating superior performance in this context. Additionally, we explore its potential in medical applications, including craniofacial analysis using 3D facial data and lesion segmentation on 3D human faces, achieving enhanced accuracy and reliability.

几何深度学习曲面卷积医学影像拟共形

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。