用单次前向传播实现多条件判断,让大模型评分快十倍还更可解释。
You Only Forward Once: An Efficient Compositional Judging Paradigm
- 设计模板驱动的单次前向推理,一次性验证所有判断条件
- 在推荐数据集上达到顶尖性能,速度比传统方法快数个数量级
- 支持条件依赖分析和事后思维链,适合需要高效可解释评估的场景
多模态大语言模型(MLLM)在作为评判者方面展现出强大潜力。然而现有方法存在根本性权衡:将MLLM用于输出单一分数会与模型生成特性不符,限制对细粒度要求的理解;而自回归生成判断分析在高吞吐场景下则过于缓慢。观察到判断本质上是验证输入是否满足一组结构化要求,我们提出YOFO,一种基于模板的单次前向传播判断方法。该方法基于自回归模型,接收结构化要求模板,在一次推理步骤中,通过读取对应要求最终标记的逻辑值,生成每个要求的二元判定结果。该设计带来数量级的速度提升,同时保持可解释性。大量实验表明,YOFO不仅在标准推荐数据集上达到当前最优表现,还支持依赖感知分析——后续判断可基于先前结果进行,并进一步受益于事后思维链(post-hoc CoT)。
原文摘要 · Abstract (English)
Multimodal large language models (MLLMs) show strong potential as judges. However, existing approaches face a fundamental trade-off: adapting MLLMs to output a single score misaligns with the generative nature of MLLMs and limits fine-grained requirement understanding, whereas autoregressively generating judging analyses is prohibitively slow in high-throughput settings. Observing that judgment reduces to verifying whether inputs satisfy a set of structured requirements, we propose YOFO, a template-conditioned method that judges all requirements in a single forward pass. Built on an autoregressive model, YOFO accepts a structured requirement template and, in one inference step, produces a binary yes/no decision for each requirement by reading the logits of the final token associated with that requirement. This design yields orders-of-magnitude speedups while preserving interpretability. Extensive experiments show that YOFO not only achieves state-of-the-art results on standard recommendation datasets, but also supports dependency-aware analysis -- where subsequent judgments are conditioned on previous ones -- and further benefits from post-hoc CoT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。