用轻量验证器动态调整模型推理,提升效率与准确率
ATLAS: Verifier-Guided Adaptive Latent Activation Steering for Efficient LLM Reasoning
- 引入轻量验证器实时评估隐藏状态,动态决定是否及如何干预
- 在数学与编码任务上,准确率更高且测试阶段用token减少30%以上
- 无需额外解码或奖励模型调用,适合追求高效推理的部署场景
近期关于激活和潜在空间干预的研究表明,修改内部表示可在不更新参数的情况下有效引导大语言模型提升推理能力与效率。然而,现有方法多依赖固定干预策略和静态强度,难以适应不同问题实例,常导致过度或不足干预。本文提出自适应测试时潜在激活引导框架ATLAS,通过在推理时训练一个轻量级验证器来评估隐藏状态质量,并据此动态选择干预动作,实现每例每步的自适应调节,开销极低。ATLAS将学习到的潜在验证与测试时激活引导统一整合,无需额外解码或奖励模型调用。在多个数学与编程推理基准上,ATLAS持续优于基线方法,在保持高准确率的同时显著降低测试阶段的词元使用量。结果表明,验证器引导的潜在自适应是一种高效且可扩展的推理控制机制。
原文摘要 · Abstract (English)
Recent work on activation and latent steering has demonstrated that modifying internal representations can effectively guide large language models (LLMs) toward improved reasoning and efficiency without updating model parameters. However, most existing approaches rely on fixed steering policies and static intervention strengths, which limit their robustness across problem instances and often result in over- or under-steering. We propose Adaptive Test-time Latent Steering (ATLAS), a lightweight framework that dynamically controls steering decisions at inference time using a trained, lightweight verifier over the latent states. Given intermediate hidden states, the verifier predicts the quality of ongoing reasoning and adaptively selects which steering action to apply, enabling per-example and per-step adjustment with minimal overhead. ATLAS provides a unified framework for combining learned latent verification with test-time activation steering, enabling adaptive reasoning control without additional LLM decoding or inference-time process reward model calls. Experiments on multiple mathematical and coding reasoning benchmarks show that ATLAS consistently outperforms both vanilla decoding and fixed steering baselines, achieving higher accuracy while substantially reducing test-time token usage. These results demonstrate that verifier-guided latent adaptation provides an effective and scalable mechanism for controlling reasoning efficiency without sacrificing solution quality. All source code will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。