将多任务学习的表示嵌入黎曼流形,提升异质任务下的稳定性与准确率。
GeoERM: Geometry-Aware Multi-Task Representation Learning on Riemannian Manifolds
- 在黎曼流形上优化共享表示,保留数据内在几何结构
- 相比欧氏基线,显著降低负迁移并提升抗噪声能力
- 适用于多种矩阵分解模型,适合高噪声或异质任务场景
多任务学习通过挖掘相关任务间的共享结构来提升统计效能和学习效率。现有先进方法通常将潜在表示矩阵视为欧几里得空间中的点,忽略了其常具有的非欧几何特性,导致在任务异质甚至对抗时鲁棒性下降。本文提出GeoERM,一种几何感知的多任务学习框架,将共享表示嵌入其自然的黎曼流形,并通过显式的流形操作进行优化。每个训练周期包含(i)尊重搜索空间固有曲率的黎曼梯度步,以及(ii)高效的极坐标回缩操作,确保每一步迭代均保持几何保真性。该方法适用于广泛的矩阵分解型多任务学习模型,且每轮迭代开销与欧氏基线相当。在具有任务异质性的合成实验及可穿戴传感器活动识别基准测试中,GeoERM持续提升估计精度,减少负迁移,在对抗标签噪声下仍保持稳定,优于主流多任务与单任务方法。
原文摘要 · Abstract (English)
Multi-Task Learning (MTL) seeks to boost statistical power and learning efficiency by discovering structure shared across related tasks. State-of-the-art MTL representation methods, however, usually treat the latent representation matrix as a point in ordinary Euclidean space, ignoring its often non-Euclidean geometry, thus sacrificing robustness when tasks are heterogeneous or even adversarial. We propose GeoERM, a geometry-aware MTL framework that embeds the shared representation on its natural Riemannian manifold and optimizes it via explicit manifold operations. Each training cycle performs (i) a Riemannian gradient step that respects the intrinsic curvature of the search space, followed by (ii) an efficient polar retraction to remain on the manifold, guaranteeing geometric fidelity at every iteration. The procedure applies to a broad class of matrix-factorized MTL models and retains the same per-iteration cost as Euclidean baselines. Across a set of synthetic experiments with task heterogeneity and on a wearable-sensor activity-recognition benchmark, GeoERM consistently improves estimation accuracy, reduces negative transfer, and remains stable under adversarial label noise, outperforming leading MTL and single-task alternatives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。