arXiv:2505.24664cs.LG2025-05被引 1

用新表示法让深度学习直接学排列分布,更高效准确。

Learning Distributions over Permutations and Rankings with Factorized Representations

  • 用莱默码等新表示法把排列映射到连续空间,可直接用普通神经网络训练。
  • 在拼图任务上显著优于现有方法,且在低表达力模式下仍能生成合理排列。
  • 适合需要建模复杂排列分布的场景,如推荐系统和组合优化。

学习排列上的概率分布是机器学习中的基础问题,应用于排序、组合优化、结构化预测和数据关联等领域。现有方法依赖参数化族的混合或需昂贵变分推断的神经网络。本文提出一种新方法,利用排列的替代表示形式——包括莱默码、费希尔-耶茨抽样和插入向量——这些表示与对称群构成双射,使概率分布可在无约束空间中使用常规深度学习技术进行建模,并能表示任意排列上的分布。该方法在模型表达能力与计算开销间提供可调平衡。在表达力最弱但计算最高效的情况下,本方法涵盖已有经典概率模型(如Mallows模型和重复插入模型)。实验表明,本方法在拼图基准任务上显著优于当前主流方法。然而我们指出,该基准仅评估单一正确解的点分布,评估能力有限。为此我们提出两个新基准:学习循环排列及基于用户偏好的电影重排序。结果显示,在表达力最低模式下,本方法仍能学习非平凡分布,而传统模型甚至无法生成有效排列。

原文摘要 · Abstract (English)

Learning distributions over permutations is a fundamental problem in machine learning, with applications in ranking, combinatorial optimization, structured prediction, and data association. Existing methods rely on mixtures of parametric families or neural networks with expensive variational inference procedures. In this work, we propose a novel approach that leverages alternative representations for permutations, including Lehmer codes, Fisher-Yates draws, and Insertion-Vectors. These representations form a bijection with the symmetric group, allowing for unconstrained learning using conventional deep learning techniques, and can represent any probability distribution over permutations. Our approach enables a trade-off between expressivity of the model family and computational requirements. In the least expressive and most computationally efficient case, our method subsumes previous families of well established probabilistic models over permutations, including Mallow's and the Repeated Insertion Model. Experiments indicate our method significantly outperforms current approaches on the jigsaw puzzle benchmark, a common task for permutation learning. However, we argue this benchmark is limited in its ability to assess learning probability distributions, as the target is a delta distribution (i.e., a single correct solution exists). We therefore propose two additional benchmarks: learning cyclic permutations and re-ranking movies based on user preference. We show that our method learns non-trivial distributions even in the least expressive mode, while traditional models fail to even generate valid permutations in this setting.

排列学习概率建模深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。