让模型自适应地学习无监督排序,提升大规模任务稳定性。
Learning Permutation from Structure Without Supervision

- 基于熵自适应调整温度,动态控制排列学习过程
- 在排序与拼图任务中,提升训练稳定性和最终排列质量
- 适合处理高复杂度、不确定性高的无监督排列问题
许多学习任务需要从无序数据中发现隐藏的有序结构,如排序中的单调性或拼图重建中的空间连续性。这类任务可通过优化重排输出的损失函数来学习隐式排列,而无需真实顺序标签。利用可微松弛(如Gumbel-Sinkhorn)将排列矩阵近似为双随机矩阵,使该方法成为可能。然而,无监督结构学习会引发非均匀的不确定性:部分分配早期即变得确定,而其他仍模糊不清。现有方法使用单一全局温度控制,迫使所有分配同步锐化或扩散,导致大规模场景下训练不稳定。本文提出一种熵自适应的Gumbel-Sinkhorn形式,根据局部分配不确定性动态调节温度。这使得高置信度分配可提前离散化,同时保留低置信区域的探索能力。在排序、拼图重建及路由类任务中,自适应熵控制显著提升了训练稳定性和最终排列质量,尤其在问题规模大、分配模糊性高的情况下优势更明显。
原文摘要 · Abstract (English)
Many learning problems require uncovering a hidden ordering that reveals structure in unordered data, such as monotonicity in sorting or spatial continuity in jigsaw reconstruction. In these settings, permutations can be learned as latent operators by optimizing objectives defined directly on the reordered output, often without access to ground-truth orderings. Differentiable relaxations such as Gumbel-Sinkhorn make this approach practical by approximating permutation matrices with doubly stochastic matrices. However, learning from structure without supervision induces a non-uniform uncertainty: some assignments become confident early, while others remain ambiguous. Existing methods control this process using a single global temperature, forcing all assignments to sharpen or diffuse simultaneously and leading to instability at scale. We introduce an entropy-adaptive formulation of Gumbel-Sinkhorn that locally modulates temperature based on assignment uncertainty. This allows confident assignments to discretize early while preserving exploration where uncertainty remains. Across sorting and jigsaw reconstruction tasks and in routing-style settings, adaptive entropy control improves training stability and final permutation quality relative to fixed-temperature baselines, particularly as problem size and assignment ambiguity increase.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。