arXiv:2603.17353cs.LGcs.AI2026-03中稿 · ICML

提出软秩扩散框架,更平滑地学习排列分布

Learning Permutation Distributions via Reflected Diffusion on Ranks

  • 用软秩替代传统打乱,实现连续潜空间中的平滑噪声过程
  • 在排序与组合优化任务中,长序列性能超越已有扩散模型
  • 适合处理序列依赖性强的排列生成问题,如排序与路径规划

有限对称群 S_n 是排列的自然定义域,但因其阶乘增长规模和离散非欧几里得结构,学习其上的概率分布极具挑战。现有排列扩散方法通过洗牌随机游走(如 riffle shuffle)进行前向加噪,并使用 Plackett-Luce(PL)变体学习反向过程,但轨迹常呈突变状,且随着 n 增大,去噪难度显著上升。本文提出 Soft-Rank Diffusion,一种离散扩散框架:将排列映射到连续潜空间,通过将离散秩松弛为软秩,实现结构化软秩前向过程,从而获得更平滑、更易处理的轨迹。在反向过程中,引入上下文化广义 Plackett-Luce(cGPL)去噪器,扩展了先前 PL 风格参数化,提升对序列决策结构的表达能力。在排序与组合优化基准测试中,Soft-Rank Diffusion 持续优于现有扩散基线,尤其在长序列和固有顺序性场景中表现突出。

原文摘要 · Abstract (English)

The finite symmetric group S_n provides a natural domain for permutations, yet learning probability distributions on S_n is challenging due to its factorially growing size and discrete, non-Euclidean structure. Recent permutation diffusion methods define forward noising via shuffle-based random walks (e.g., riffle shuffles) and learn reverse transitions with Plackett-Luce (PL) variants, but the resulting trajectories can be abrupt and increasingly hard to denoise as n grows. We propose Soft-Rank Diffusion, a discrete diffusion framework that replaces shuffle-based corruption with a structured soft-rank forward process: we lift permutations to a continuous latent representation of order by relaxing discrete ranks into soft ranks, yielding smoother and more tractable trajectories. For the reverse process, we introduce contextualized generalized Plackett-Luce (cGPL) denoisers that generalize prior PL-style parameterizations and improve expressivity for sequential decision structures. Experiments on sorting and combinatorial optimization benchmarks show that Soft-Rank Diffusion consistently outperforms prior diffusion baselines, with particularly strong gains in long-sequence and intrinsically sequential settings.

排列学习扩散模型序列生成软秩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。