arXiv:2605.14518cs.CVcs.LG2026-05

自适应激活函数ArcGate提升遥感图像识别精度与抗噪能力

ArcGate: Adaptive Arctangent Gated Activation

论文配图:ArcGate: Adaptive Arctangent Gated Activation
图 1 · 摘自论文原文
  • 通过七参数自适应调整非线性形状,动态匹配深层特征需求
  • 在PatternNet上达99.67%准确率,噪声下比ReLU高26.65%性能
  • 适合高分辨率遥感图像任务,尤其在数据含噪场景优势明显

激活函数是深度网络的核心,影响非线性、特征学习、收敛性和鲁棒性。本文提出自适应反正切门控激活函数(ArcGate),通过三阶段非线性变换生成多样激活形态。与ReLU、GELU或SiLU等固定形状激活不同,ArcGate每层包含七个可学习参数,使网络自主优化非线性以适配特征层次和数据分布。我们在ResNet-50和Vision Transformer (ViT-B/16)上,于PatternNet、UC Merced Land Use及13波段EuroSAT MSI多光谱数据集上评估了ArcGate。实验表明,其持续优于标准基线,在PatternNet上达到99.67%峰值准确率。尤为突出的是,在中等高斯噪声(标准差0.1)下,其性能比ReLU领先26.65%。参数分析显示,模型在深层增强门控强度,促进信号传播。结果表明,ArcGate是高分辨率地球观测任务中稳健且自适应的通用激活函数。

原文摘要 · Abstract (English)

Activation functions are central to deep networks, influencing non-linearity, feature learning, convergence, and robustness. This paper proposes the Adaptive Arctangent Gated Activation (ArcGate) function, a flexible formulation that generates a broad spectrum of activation shapes via a three-stage non-linear transformation. Unlike conventional fixed-shape activations such as ReLU, GELU, or SiLU, ArcGate uses seven learnable parameters per layer, allowing the neural network to autonomously optimize its non-linearity to the specific requirements of the feature hierarchy and data distribution. We evaluate ArcGate using ResNet-50 and Vision Transformer (ViT-B/16) architectures on three widely used remote sensing benchmarks: PatternNet, UC Merced Land Use, and the 13-band EuroSAT MSI multispectral dataset. Experimental results show that ArcGate consistently outperforms standard baselines, achieving a peak overall accuracy of 99.67% on PatternNet. Most notably, ArcGate exhibits superior structural resilience in noisy environments, maintaining a 26.65% performance lead over ReLU under moderate Gaussian noise (standard deviation 0.1). Analysis of the learned parameters reveals a depth-dependent functional evolution, where the model increases gating strength in deeper layers to enhance signal propagation. These findings suggest that ArcGate is a robust and adaptive general node activation function for high-resolution earth observation tasks.

激活函数遥感图像自适应抗噪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。