arXiv:2602.23777cs.AI2026-02中稿 · ICLR被引 9

用大模型推理链提升跨域泛化能力,效果优于传统方法。

Reasoning-Driven Multimodal LLM for Domain Generalization

  • 引入多任务交叉训练与自对齐推理正则,增强推理链指导性
  • 在PACS、VLCS等5个数据集上达到当前最优性能
  • 适合关注模型鲁棒性与推理机制融合的研究者

本文针对深度学习中的域泛化(DG)问题,提出利用多模态大语言模型(MLLM)的推理能力构建图像类别推理链,以提升域迁移下的预测鲁棒性。为此,我们构建了DomainBed-Reasoning数据集,包含每个样本对应的类别相关推理链。分析发现:(i) 使用推理链进行微调比直接标签监督更难,因需优化复杂推理序列;(ii) 推理模式不匹配导致语义丰富性与优化效率之间的权衡。为此,提出RD-MLDG框架,包含两个组件:(i) MTCT(多任务交叉训练),引入直接分类路径引导推理监督;(ii) SARR(自对齐推理正则),通过迭代自标注保留推理链语义丰富性并缓解模式错配。在标准数据集PACS、VLCS、OfficeHome、TerraInc上的实验表明,RD-MLDG取得当前最优表现,验证了推理作为鲁棒域外泛化的有效补充信号。

原文摘要 · Abstract (English)

This paper addresses the domain generalization (DG) problem in deep learning. While most DG methods focus on enforcing visual feature invariance, we leverage the reasoning capability of multimodal large language models (MLLMs) and explore the potential of constructing reasoning chains that derives image categories to achieve more robust predictions under domain shift. To this end, we systematically study the role of reasoning in DG using DomainBed-Reasoning, a newly constructed extension of DomainBed dataset, in which each sample is paired with class-relevant reasoning chains. Our analysis reveals two key challenges: (i) fine-tuning MLLMs with reasoning chains for classification is more challenging than direct label supervision, since the model must optimize complex reasoning sequences before label prediction; and (ii) mismatches in reasoning patterns between supervision signals and fine-tuned MLLMs lead to a trade-off between semantic richness (informative but harder to optimize) and optimization efficiency (easier to optimize but less informative). To address these issues, we propose RD-MLDG (Reasoning-Driven Multimodal LLM for Domain Generalization), a framework with two components: (i) MTCT (Multi-Task Cross-Training), which introduces an additional direct classification pathway to guide reasoning supervision; and (ii) SARR (Self-Aligned Reasoning Regularization), which preserves the semantic richness of reasoning chains while mitigating reasoning-pattern mismatches via iterative self-labeling. Experiments on standard DomainBed datasets (PACS, VLCS, OfficeHome, TerraInc) demonstrate that RD-MLDG achieves state-of-the-art performances, highlighting reasoning as a promising complementary signal for robust out-of-domain generalization.

域泛化多模态大模型推理链自对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。