提出无需能量函数的测试时投票方法,提升推理模型准确率
C-voting: Confidence-Based Test-Time Voting without Explicit Energy Functions
- 基于置信度选择最优推理路径,不依赖显式能量函数
- 在Sudoku-hard上比传统方法高4.9%准确率,Sudoku-extreme达95.2%
- 适用于任意递归结构模型,特别适合无能量函数的推理系统
具有潜在递归处理的神经网络模型因其能在测试阶段通过增加迭代步数提升性能而受到关注。这类模型如分层推理模型(HRM)和人工柯朗托振子神经元(AKOrN),通过增加递归步骤实现深度推理,可完成数独、迷宫求解及AGI基准等复杂任务。本文提出置信度投票(C-voting)策略,针对具有多个潜在推理轨迹的递归模型,在初始化时使用随机变量生成多个候选状态,选取预测结果中最高前1位概率平均值最大的路径,反映模型置信度。该方法无需显式能量函数,且在Sudoku-hard任务上较基于能量的投票策略提高4.9%准确率。此外,我们提出一种基于注意力机制的递归模型ItrSA++,结合C-voting后,在Sudoku-extreme任务上达到95.2%准确率(优于HRM的55.0%),在迷宫任务上为78.6%(优于HRM的74.5%)。
原文摘要 · Abstract (English)
Neural network models with latent recurrent processing, where identical layers are recursively applied to the latent state, have gained attention as promising models for performing reasoning tasks. A strength of such models is that they enable test-time scaling, where the models can enhance their performance in the test phase without additional training. Models such as the Hierarchical Reasoning Model (HRM) and Artificial Kuramoto Oscillatory Neurons (AKOrN) can facilitate deeper reasoning by increasing the number of recurrent steps, thereby enabling the completion of challenging tasks, including Sudoku, Maze solving, and AGI benchmarks. In this work, we introduce confidence-based voting (C-voting), a test-time scaling strategy designed for recurrent models with multiple latent candidate trajectories. Initializing the latent state with multiple candidates using random variables, C-voting selects the one maximizing the average of top-1 probabilities of the predictions, reflecting the model's confidence. Additionally, it yields 4.9% higher accuracy on Sudoku-hard than the energy-based voting strategy, which is specific to models with explicit energy functions. An essential advantage of C-voting is its applicability: it can be applied to recurrent models without requiring an explicit energy function. Finally, we introduce a simple attention-based recurrent model with randomized initial values named ItrSA++, and demonstrate that when combined with C-voting, it outperforms HRM on Sudoku-extreme (95.2% vs. 55.0%) and Maze (78.6% vs. 74.5%) tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。