用卷积核几何引导特征演化,提升模型性能。
Dual-Manifold Geometry Guided Representation Learning: Adaptive Coupling between Kernel and Data Spaces

- 构建卷积核与特征的双流几何空间,通过核矩阵生成引导变换
- 在多个模型上实现图像分类与算术推理任务的稳定提升
- 适合关注模型内部结构与特征优化的研究者
深度表示学习长期关注特征在层间的演变,却忽视了网络参数中嵌入的结构化几何。本文提出双流流形视角:每个卷积层包含由卷积核诱导的核流形和由中间特征表征构成的数据流形。由于两者共享通道空间,参数几何可为特征演化提供互补结构信息。基于此,我们提出轻量级模块KGFT,从核格拉姆矩阵提取几何引导矩阵,用于重塑特征表示的协方差结构。不同于传统注意力机制重加权特征响应,KGFT显式通过将核流形的几何信息传递至数据流形来重构特征关系。为适应网络层级结构,引入“利用”与“探索”模式,结合深度感知调度策略和可学习的引导强度,自适应调控几何变换贡献度。该设计在浅层促进几何对齐,在深层鼓励特征多样性,不施加过度约束。理论分析验证了变换有效性并刻画其对特征协方差的影响。跨CNN与Transformer架构(包括ResNet、ViT、LLaMA-7B)的大量实验表明,该方法在图像分类与算术推理任务上均取得一致提升,验证了其通用性与有效性。代码将公开。
原文摘要 · Abstract (English)
Deep representation learning has primarily focused on how features evolve across network layers, while largely overlooking the structured geometry embedded in network parameters. We introduce a dual-manifold perspective in which each convolutional layer contains two coupled geometric spaces: a Kernel Manifold induced by convolutional filters and a Data Manifold characterized by intermediate feature representations. Because these manifolds share the same channel space, parameter geometry can provide complementary structural information to guide feature evolution. Based on this insight, we propose Kernel-Guided Feature Transform (KGFT), a lightweight module that derives a geometric guidance matrix from the kernel Gram matrix and uses it to transform the covariance structure of feature representations. Unlike conventional attention mechanisms that reweight feature responses, KGFT explicitly reshapes feature relationships by transferring geometric information from the kernel manifold to the data manifold. To accommodate network hierarchy, we further introduce Exploit and Explore modes with a depth-aware scheduling strategy and a learnable guidance strength that adaptively controls the contribution of geometric transformation. This design promotes geometric alignment in shallow layers while encouraging feature diversity in deeper layers, without imposing excessive constraints on representation learning. Theoretical analysis establishes the validity of the proposed transformation and characterizes its effect on feature covariance. Extensive experiments across CNN- and Transformer-based architectures, including ResNet, ViT, and LLaMA-7B, demonstrate consistent improvements on image classification and arithmetic reasoning tasks, validating the generality and effectiveness of kernel-guided dual-manifold representation learning. Code will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。