arXiv:2608.19021cs.CV2026-08

提出无需分解的矩阵对数近似方法,提升特征归一化速度与精度。

Orthogonal Polynomial Approximation for Matrix Log Normalization in Global Covariance Pooling

论文配图:Orthogonal Polynomial Approximation for Matrix Log Normalization in Global Covariance Pooling
图 1 · 摘自论文原文
  • 用多项式逼近矩阵对数,避免特征分解,仅用矩阵乘法实现
  • 在三个细粒度数据集上比谱对数和平方根法更快更准
  • 证明性能提升源于更忠实的黎曼映射,而非多项式类型优势

全局协方差池化(GCP)通过捕捉二阶特征统计量增强深度网络,在细粒度识别中尤为有效。由于协方差矩阵位于对称正定(SPD)流形上,需进行归一化后才能使用欧氏分类器。最准确的方法是矩阵对数(MLN-COV),将其映射到切空间;但实践中因基于特征分解的梯度数值不稳定而被放弃,改用矩阵平方根。本文揭示该不稳定性源于谱计算方式,而非对数本身。通过有限多项式在协方差矩阵上的逼近,完全移除特征分解:所有操作转为通用矩阵乘法(GEMM),梯度在预归一化协方差的谱范围内保持有界,且永不出现不稳定的1/(λ_i−λ_j)项。关键在于均值特征值预归一化,将谱中心移至1附近以避开log的奇点,并通过标量后补偿恢复log(A)的奇异部分。推荐使用8次切比雪夫展开,通过三重矩阵递推计算,反向传播采用匹配的逆递推;同时研究了勒让德、拉盖尔、泰勒和佩德展开作为对照,以分离基函数与目标函数的作用。在三个细粒度基准和ImageNet-1k上,该无分解对数方法在速度与精度上均优于谱对数及替代的平方根近似,在相同基函数与次数下,对数目标表现超越平方根目标,证实性能提升源于更忠实的黎曼映射,而非更优的多项式族。

原文摘要 · Abstract (English)

Global Covariance Pooling (GCP) improves deep networks by capturing second-order feature statistics, and is especially effective for fine-grained recognition. Because covariance matrices live on the Symmetric Positive Definite (SPD) manifold, a normalization step is required before the Euclidean classifier. The faithful choice is the matrix logarithm (MLN-COV), which maps the SPD manifold to its tangent space; in practice it was abandoned in favour of the matrix square root because its eigendecomposition-based gradient is numerically unstable. We show that this instability is an artifact of computing the logarithm spectrally, not of the logarithm itself. Approximating the logarithm with finite polynomials in the covariance matrix removes the eigendecomposition from both passes: every operation becomes a General Matrix Multiplication (GEMM), the gradient stays bounded on the spectral support of the pre-normalized covariance, and the unstable 1/(lambda_i-lambda_j) term never appears. The key ingredient is a mean-eigenvalue pre-normalization that centres the spectrum near 1, away from the singularity of log, with a scalar post-compensation that returns the singular part of log(A) in closed form. Our recommended normalizer is a degree-8 Chebyshev expansion evaluated by a three-term matrix recurrence, with a matching reverse recurrence for the backward pass; Legendre, Laguerre, Taylor and Pade expansions are studied as controls that isolate the roles of the basis and of the target function. On three fine-grained benchmarks and ImageNet-1k the decomposition-free logarithm is both faster and more accurate than the spectral logarithm and than the square-root approximations it replaces, and at matched basis and degree the log target beats the square-root target, confirming that the gain comes from the faithful Riemannian map rather than from a better polynomial family.

矩阵对数协方差池化深度学习优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。