用多项式核提升非线性相关系数的计算鲁棒性
Robust Non-Linear Correlations via Polynomial Regression
- 采用可配置多项式核计算HGR相关系数
- 相比旧方法更稳定,计算速度更快且效果接近
- 适合对可靠性要求高的机器学习场景
Hirschfeld-Gebelein-Rényi(HGR)相关系数是皮尔逊相关性的扩展,可用于非线性关系建模,在算法公平性、科学分析和因果发现中具有潜力。近期已有可微分估计HGR的新算法,用于作为约束机器学习中的损失正则项。然而,由于HGR本身不可直接计算,现有方法面临偏差-方差权衡问题,可能影响实际应用中的鲁棒性。本文提出一种基于用户可配置多项式核的新计算方法,显著提升了鲁棒性和确定性,同时实现更快但几乎等效的约束能力。实验表明,该方法在约束机器学习框架中能生成有意义的次梯度,可作为有效的损失正则化项。
原文摘要 · Abstract (English)
The Hirschfeld-Gebelein-Rényi (HGR) correlation coefficient is an extension of Pearson's correlation that is not limited to linear correlations, with potential applications in algorithmic fairness, scientific analysis, and causal discovery. Recently, novel algorithms to estimate HGR in a differentiable manner have been proposed to facilitate its use as a loss regularizer in constrained machine learning applications. However, the inherent uncomputability of HGR requires a bias-variance trade-off, which can possibly compromise the robustness of the proposed methods, hence raising technical concerns if applied in real-world scenarios. We introduce a novel computational approach for HGR that relies on user-configurable polynomial kernels, offering greater robustness compared to previous methods and featuring a faster yet almost equally effective restriction. Our approach provides significant advantages in terms of robustness and determinism, making it a more reliable option for real-world applications. Moreover, we present a brief experimental analysis to validate the applicability of our approach within a constrained machine learning framework, showing that its computation yields an insightful subgradient that can serve as a loss regularizer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。