用几何代数统一视觉特征交互,小模型也能达到顶尖性能
CliffordNet: All You Need is Geometric Algebra
- 基于几何代数的统一乘积运算,同时捕捉特征一致性和结构变化
- 纳米版仅140万参数达77.82%准确率,参数量仅为ResNet-18的1/8
- 轻量版260万参数刷新微型模型新纪录,无需传统前馈网络
现代计算机视觉架构如CNN与Transformer,普遍采用空间混合器(注意力/卷积)与通道混合器(前馈网络)堆叠的启发式设计。本文挑战这一范式,回归数学基本原理,提出基于几何代数的视网膜主干网络(CliffordNet)。通过克莱夫福德几何积 $uv = u \cdot v + u \wedge v$ 构建统一交互机制,同时利用广义内积捕获特征一致性、外积捕捉结构变化,实现代数完备性。该机制以高效稀疏滚动方式实现,复杂度严格为线性 $O(N)$。实验发现,这种几何交互具有高度表示密度,使标准前馈网络变得冗余。实证表明,CliffordNet在帕累托前沿取得突破:纳米版在CIFAR-100上达77.82%准确率,仅140万参数,相当于重模型ResNet-18(1120万参数)的8倍压缩;轻量版(260万参数)在微型模型中达79.05%新高。结果表明,全局理解可由严谨的局部几何交互自然涌现,或预示几何即一切的新范式。代码已开源。
原文摘要 · Abstract (English)
Modern computer vision architectures, from CNNs to Transformers, predominantly rely on the stacking of heuristic modules: spatial mixers (Attention/Conv) followed by channel mixers (FFNs). In this work, we challenge this paradigm by returning to mathematical first principles. We propose the Clifford Algebra Network (CAN), also referred to as CliffordNet, a vision backbone grounded purely in Geometric Algebra. Instead of engineering separate modules for mixing and memory, we derive a unified interaction mechanism based on the Clifford Geometric Product ($uv = u \cdot v + u \wedge v$). This operation ensures algebraic completeness regarding the Geometric Product by simultaneously capturing feature coherence (via the generalized inner product) and structural variation (via the exterior wedge product). Implemented via an efficient sparse rolling mechanism with strict linear complexity $O(N)$, our model reveals a surprising emergent property: the geometric interaction is so representationally dense that standard Feed-Forward Networks (FFNs) become redundant. Empirically, CliffordNet establishes a new Pareto frontier: our Nano variant achieves 77.82\% accuracy on CIFAR-100 with only 1.4M parameters, effectively matching the heavy-weight ResNet-18 (11.2M) with $8\times$ fewer parameters, while our Lite variant (2.6M) sets a new SOTA for tiny models at 79.05\%. Our results suggest that global understanding can emerge solely from rigorous, algebraically complete local interactions, potentially signaling a shift where geometry is all you need. Code is available at https://github.com/ParaMind2025/CAN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。