让大模型在回答问题时自我优化,精准匹配查询内容。
Query-Conditioned Test-Time Self-Training for Large Language Models

- 用输入问题自动生成训练对,实现推理时的参数微调。
- 在7个数学推理和GPQA-Diamond基准上超越现有方法。
- 无需外部数据,适合需要精准响应的问答场景。
大语言模型通常以固定参数部署,性能提升依赖推理时增加计算量。尽管测试时扩展有效,但无法纠正模型误解或适配特定查询结构。测试时优化通过推理期间更新参数弥补此缺陷,但现有方法要么依赖外部数据,要么优化通用自监督目标,缺乏查询相关性。本文提出查询条件测试时自训练(QueST),利用输入查询本身生成结构相关的“问题-解答”对,作为监督信号,在测试时进行参数高效微调。适应后的模型生成最终答案,实现无外部数据的查询特异性调整。在七个数学推理基准及GPQA-Diamond科学推理基准上,QueST持续优于强基线。结果表明,查询条件自训练是大模型测试时适应的有效且实用范式。
原文摘要 · Abstract (English)
Large language models (LLMs) are typically deployed with fixed parameters, and their performance is often improved by allocating more computation at inference time. While such test-time scaling can be effective, it cannot correct model misconceptions or adapt the model to the specific structure of an individual query. Test-time optimization addresses this limitation by enabling parameter updates during inference, but existing approaches either rely on external data or optimize generic self-supervised objectives that lack query-specific alignment. In this work, we propose Query-Conditioned Test-Time Self-Training (QueST), a framework that adapts model parameters during inference using supervision derived directly from the input query. Our key insight is that the input query itself encodes latent signals sufficient for constructing structurally related problem--solution pairs. Based on this, QueST generates such query-conditioned pairs and uses them as supervision for parameter-efficient fine-tuning at test time. The adapted model is then used to produce the final answer, enabling query-specific adaptation without any external data. Across seven mathematical reasoning benchmarks and the GPQA-Diamond scientific reasoning benchmark, QueST consistently outperforms strong test-time optimization baselines. These results demonstrate that query-conditioned self-training is an effective and practical paradigm for test-time adaptation in LLMs. Code is available at https://chssong.github.io/Query-Conditioned-TTST/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。