arXiv:2504.18849cs.LGeess.IV2025-04被引 1

用分数阶微积分和指数调制改进梯度下降,提升乳腺癌分类准确率与收敛速度。

Theoretical Framework for Tempered Fractional Gradient Descent: Application to Breast Cancer Classification

  • 引入带指数调制的记忆机制,用分数阶权重融合历史梯度
  • 在乳腺癌数据集上达98.25%准确率,收敛速度是SGD的两倍
  • 适合高维噪声数据,尤其对特征相关性强的医疗分类任务有效

本文提出一种新型优化框架——调制分数阶梯度下降(TFGD),通过将分数阶微积分与指数调制结合,改进基于梯度的学习。传统梯度下降在高维、噪声环境中常出现振荡更新和收敛缓慢问题。TFGD通过引入调制记忆机制,使历史梯度按分数阶系数 $|w_j| = inomα{j}$ 加权,并通过调制参数 $λ$ 指数衰减。理论分析表明,在凸环境下,其收敛速率达 $/mathcal{O}(1/K)$,其中对齐系数 $d_{α,λ} = (1 - e^{-λ})^{-α}$;随机变体达到 $/mathcal{O}(1/k^α)$ 的误差衰减速率。算法时间复杂度保持 $/mathcal{O}(n)$,与SGD相当,内存开销为 $/mathcal{O}(d/λ)$($d$ 为参数维度)。在乳腺癌威斯康星数据集上的实证验证显示,TFGD测试准确率达98.25%(对比SGD的92.11%),收敛速度提升2倍。调制记忆机制在医学分类任务中尤为有效,因能稳定平均特征相关性梯度。结果表明,TFGD在理论与应用层面均为传统优化器的有力替代方案。

原文摘要 · Abstract (English)

This paper introduces Tempered Fractional Gradient Descent (TFGD), a novel optimization framework that synergizes fractional calculus with exponential tempering to enhance gradient-based learning. Traditional gradient descent methods often suffer from oscillatory updates and slow convergence in high-dimensional, noisy landscapes. TFGD addresses these limitations by incorporating a tempered memory mechanism, where historical gradients are weighted by fractional coefficients $|w_j| = \binomα{j}$ and exponentially decayed via a tempering parameter $λ$. Theoretical analysis establishes TFGD's convergence guarantees: in convex settings, it achieves an $\mathcal{O}(1/K)$ rate with alignment coefficient $d_{α,λ} = (1 - e^{-λ})^{-α}$, while stochastic variants attain $\mathcal{O}(1/k^α)$ error decay. The algorithm maintains $\mathcal{O}(n)$ time complexity equivalent to SGD, with memory overhead scaling as $\mathcal{O}(d/λ)$ for parameter dimension $d$. Empirical validation on the Breast Cancer Wisconsin dataset demonstrates TFGD's superiority, achieving 98.25\% test accuracy (vs. 92.11\% for SGD) and 2$\times$ faster convergence. The tempered memory mechanism proves particularly effective in medical classification tasks, where feature correlations benefit from stable gradient averaging. These results position TFGD as a robust alternative to conventional optimizers in both theoretical and applied machine learning.

优化算法医疗分类分数阶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。