用通用文本训练让模型跨模态跨领域推理,效果超越专训模型。
X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
- 仅用通用文本分两阶段微调,实现跨模态推理能力
- 在通用和医疗任务上超越现有顶尖多模态模型
- 医疗版通过专用文本继续训练,刷新多项基准
近期闭源模型(如 o3)已展现出强大的多模态推理能力。然而,多数开源研究仍聚焦于纯文本推理模型的训练,评估也主要局限于数学和通用领域任务。因此,如何有效拓展推理能力至非文本输入和特定领域仍不明确。本文探究核心问题:推理是否可跨模态与领域泛化?结果支持肯定回答:通用文本后训练可实现强泛化推理。基于此,我们提出 X-Reasoner,一个仅在通用文本上进行后训练的视觉语言模型,采用两阶段方法:先用提炼的长思维链监督微调,再通过可验证奖励进行强化学习。实验表明,X-Reasoner 能成功将推理能力迁移到多模态及域外场景,在多个通用与医学基准上超越使用域内和多模态数据训练的现有最先进模型。此外,通过在特定领域文本上持续训练,可进一步提升其性能。据此,我们推出 X-Reasoner-Med 医疗专用版本,在多项纯文本与多模态医疗基准上达到新最优表现。
原文摘要 · Abstract (English)
Recent proprietary models (e.g., o3) have begun to demonstrate strong multimodal reasoning capabilities. Yet, most existing open-source research concentrates on training text-only reasoning models, with evaluations limited to mainly mathematical and general-domain tasks. Therefore, it remains unclear how to effectively extend reasoning capabilities beyond text input and general domains. This paper explores a fundamental research question: Is reasoning generalizable across modalities and domains? Our findings support an affirmative answer: General-domain text-based post-training can enable such strong generalizable reasoning. Leveraging this finding, we introduce X-Reasoner, a vision-language model post-trained solely on general-domain text for generalizable reasoning, using a two-stage approach: an initial supervised fine-tuning phase with distilled long chain-of-thoughts, followed by reinforcement learning with verifiable rewards. Experiments show that X-Reasoner successfully transfers reasoning capabilities to both multimodal and out-of-domain settings, outperforming existing state-of-the-art models trained with in-domain and multimodal data across various general and medical benchmarks (Figure 1). Additionally, we find that X-Reasoner's performance in specialized domains can be further enhanced through continued training on domain-specific text-only data. Building upon this, we introduce X-Reasoner-Med, a medical-specialized variant that achieves new state of the art on numerous text-only and multimodal medical benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。