arXiv:2509.23183cs.LGcs.NI2025-09被引 3

提出零对称结构防止测试时熵优化崩溃,提升模型推理稳定性。

ZeroSiam: An Efficient Asymmetry for Test-Time Entropy Optimization without Collapse

  • 采用不对称孪生结构与可学习预测器防崩溃
  • 在视觉和语言任务中显著稳定性能,零额外开销
  • 适合小型模型或易崩溃场景的实时推理优化

测试时熵最小化能提升模型在新环境中的适应能力并激发推理潜力,通过利用自身预测实时演化改进。但纯熵最小化可能引发非泛化捷径,如过度放大logit范数、使所有预测趋向单一类别,导致恒定独热输出等崩溃解,无法实现有效学习。本文揭示不对称性是防止崩溃的关键机制,提出零对称(ZeroSiam)——一种专为测试时熵最小化设计的高效非对称孪生架构。其通过可学习预测器与梯度截断操作实现非对称分歧对齐,有效防止崩溃,并在无崩溃时仍能正则化偏差学习信号,提升性能。实验表明,尽管结构简单,ZeroSiam在多种挑战性测试场景和不同模型(包括极易崩溃的小型模型)上均表现更稳定,且开销极低,在视觉适应与大语言模型推理任务中均验证了有效性。

原文摘要 · Abstract (English)

Test-time entropy minimization helps adapt a model to novel environments and incentivize its reasoning capability, unleashing the model's potential during inference by allowing it to evolve and improve in real-time using its own predictions, achieving promising performance. However, pure entropy minimization can favor non-generalizable shortcuts, such as inflating the logit norm and driving all predictions to a dominant class to reduce entropy, risking collapsed solutions (e.g., constant one-hot outputs) that trivially minimize the objective without meaningful learning. In this paper, we reveal asymmetry as a key mechanism for collapse prevention and introduce ZeroSiam--an efficient asymmetric Siamese architecture tailored for test-time entropy minimization. ZeroSiam prevents collapse through asymmetric divergence alignment, efficiently achieved by a learnable predictor and a stop-gradient operator before the classifier. We provide empirical and theoretical evidence that ZeroSiam not only prevents collapse, but also regularizes biased learning signals, enhancing performance even when no collapse occurs. Despite its simplicity, extensive results show that ZeroSiam performs more stably over prior methods using negligible overhead, demonstrating efficacy on both vision adaptation and large language model reasoning tasks across challenging test scenarios and diverse models, including particularly collapse-prone tiny models.

测试时优化模型鲁棒性熵最小化小模型推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。