arXiv:2609.04645cs.IRcs.CL2026-09

解决多模态推荐中视觉信息随推理衰减的问题

Latent-Aligned Reasoning for Multimodal Recommendation

论文配图:Latent-Aligned Reasoning for Multimodal Recommendation
图 1 · 摘自论文原文
  • 引入可学习潜在标记,与文本推理链交错对齐视觉编码器
  • 在三个公开数据集和一个工业数据集上达到顶尖性能
  • 适合关注多模态推荐与跨模态保持的算法研究者

多模态视觉-语言模型在跨模态理解方面表现卓越,但在推荐任务中面临根本挑战:随着多步推理进行,视觉与文本信号逐步衰减——我们称之为跨模态稀释。为此,我们提出LARK(Latent-Aligned Reasoning framework),一种两阶段潜在推理框架,内含互补对齐机制。第一阶段,在多步思维链(CoT)中插入可学习的潜在标记,并显式对齐冻结的视觉编码器,作为视觉检查点以保留感知细节。第二阶段,通过桥接MLP投影潜在表示,并使用物品-物品对比学习训练;为防止推理语义消退,中间特征与第一阶段的CoT隐藏状态对齐,将最终嵌入锚定于模型自身的推理输出。在三个公开基准和一个工业数据集上的实验表明,LARK在多种推荐架构中均达到最先进的性能,受控消融实验证明了每个组件的独特贡献。

原文摘要 · Abstract (English)

Multimodal Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding, yet a fundamental challenge persists when applying them to recommendation: as representations propagate through multi-step reasoning, both visual and textual signals progressively attenuate - a phenomenon we term cross-modal dilution. To address this, we propose LARK (Latent-Aligned Reasoning frameworK), a two-stage latent reasoning framework with complementary alignment mechanisms within a single VLM. In the first stage, learnable latent tokens are interleaved with multi-step chain-of-thought (CoT) reasoning and explicitly aligned with a frozen vision encoder, serving as visual checkpoints that preserve perceptual details throughout the reasoning chain. In the second stage, the latent representations are projected via a bridge MLP and trained with item-to-item contrastive learning; to prevent the reasoning semantics from fading, intermediate features are aligned with the CoT hidden states from the first stage, anchoring the final embeddings to the model's own reasoning output. Experiments on three public benchmarks and one industrial dataset show that LARK achieves state-of-the-art performance across multiple recommendation architectures, with controlled ablations confirming the distinct contribution of each component.

多模态推荐视觉语言模型推理对齐跨模态稀释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。