arXiv:2602.07262cs.CV2026-02

通过螺旋扭曲捕捉通道间局部配对关系,提升纹理识别精度。

TwistNet-2D: Learning Second-Order Channel Interactions via Spiral Twisting for Texture Recognition

  • 用螺旋位移+归一化乘积建模通道间局部配对交互
  • 在四个纹理数据集上超越参数相当及更大模型表现
  • 结构轻量且生成方向敏感的可解释特征,适合纹理分析任务

二阶特征统计对纹理识别至关重要,但现有方法存在结构矛盾:双线性池化与格拉姆矩阵虽能捕获全局通道相关性,却丢失空间结构;自注意力模型通过加权求和捕捉跨位置关系,而非显式成对乘积。本文提出TwistNet-2D,一种轻量级模块,通过沿指定方向位移后进行L2归一化通道乘积,计算局部成对通道乘积,同时编码特征共现位置与交互方式。核心组件螺旋扭曲通道交互(STCI)在特定方向上偏移一个特征图后执行通道乘积,捕捉具有结构化和周期性特征的共现模式。四个方向头通过内容自适应通道重加权聚合,结果通过近零初始化的Sigmoid门控残差路径注入。相较ResNet-18,TwistNet-2D仅增加约3.5%参数和约2%浮点运算量。所有模型均从零训练,未使用ImageNet预训练。在此设置下,该模型在四个纹理与细粒度识别基准上持续优于参数匹配基线,并显著超越更大规模的ConvNeXt与Swin Transformer骨干网络。多头结构产生可解释、方向选择性表征,符合经典纹理分析规律。

原文摘要 · Abstract (English)

Second-order feature statistics are central to texture recognition, yet existing mechanisms exhibit a structural tension: bilinear pooling and Gram matrices capture global channel correlations but discard spatial structure, whereas self-attention models capture cross-position relations through weighted sums rather than explicit pairwise products. We propose TwistNet-2D, a lightweight module that computes local pairwise channel products under directional spatial displacement, jointly encoding where features co-occur and how they interact. The core component, Spiral-Twisted Channel Interaction (STCI), shifts one feature map along a prescribed direction before L2-normalized channel multiplication, capturing cross-position co-occurrence patterns that characterize structured and periodic textures. Four directional heads are aggregated through content-adaptive channel reweighting, and the result is injected via a sigmoid-gated residual path with near-zero initialization. TwistNet-2D adds only approximately 3.5% parameters and approximately 2% FLOPs over ResNet-18. To isolate the contribution of architectural inductive bias from that of transfer learning, all models in this study are trained from scratch without ImageNet pretraining. Under this protocol, TwistNet-2D consistently surpasses parameter-matched baselines and substantially larger ConvNeXt and Swin Transformer backbones across four texture and fine-grained recognition benchmarks, while the multi-head structure produces interpretable, orientation-selective representations that align with classical texture analysis.

纹理识别通道交互轻量化模型螺旋结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。