arXiv:2604.00013cs.CLcs.AI2026-04

用分步推理+提示引导强化学习,让多模态情感分析更可解释且泛化更强。

C2F-Thinker: Coarse-to-Fine Reasoning with Hint-Guided Reinforcement Learning for Multimodal Sentiment Analysis

  • 分两阶段训练:先用教师模型蒸馏结构化推理数据,再用提示引导强化学习优化决策路径。
  • 在细粒度情感回归任务上表现优异,跨域泛化能力显著优于基线模型。
  • 适合需要可解释性与鲁棒性的实际场景,如客服系统、舆情监控等。

多模态情感分析旨在融合文本、语音和视觉信息以实现深层情绪理解。尽管通过监督微调的多模态大模型(MLLMs)取得进展,但其“黑箱”特性阻碍了可解释性。链式思维(CoT)推理虽具潜力,却受限于高人工标注成本及强化学习(RL)固有的奖励稀疏性与难样本探索效率低等问题。本文提出C2F-Thinker框架,通过两阶段渐进式训练,将粗到精的结构化推理与提示引导强化学习相结合。第一阶段采用高质量的CoT数据进行冷启动监督微调,包含极性判断、中间分析与细粒度评分三个阶段,使基础模型具备结构化情感推理范式。第二阶段引入提示引导的组相对策略优化(GRPO)算法,在采样过程中注入正确的初始极性预测作为提示,引导模型走向准确推理路径,有效缓解级联错误并提升难样本利用率。同时设计包含分类、回归与格式约束的多维度奖励函数,兼顾预测精度与可解释性。实验表明,C2F-Thinker在细粒度情感回归任务上表现竞争,跨域泛化能力显著超越基线,展现出构建可信、鲁棒情感分析系统的潜力。

原文摘要 · Abstract (English)

Multimodal sentiment analysis aims to integrate textual, acoustic, and visual information for deep emotional understanding. Despite the progress of multimodal large language models (MLLMs) via supervised fine-tuning, their "black-box" nature hinders interpretability. While Chain-of-Thought (CoT) reasoning offers a potential remedy, it is constrained by high manual annotation costs and the inherent challenges of reinforcement learning (RL), such as reward sparsity and low exploration efficiency on hard samples. This paper presents C2F-Thinker, a framework that harmonizes coarse-to-fine structured reasoning with hint-guided RL through a two-stage progressive training pipeline. In the first stage, we conduct cold-start supervised fine-tuning using high-quality CoT data distilled from a larger teacher model, consisting of three distinct phases: polarity judgment, intermediate analysis, and fine-grained scoring. This equips the base model with a structured emotional reasoning paradigm. In the second stage, we introduce a hint-guided Group Relative Policy Optimization (GRPO) algorithm. By injecting correct initial polarity predictions as hints during the sampling process, the model is guided toward accurate reasoning paths, effectively mitigating cascading errors and enhancing the utilization of hard samples. Furthermore, a multi-faceted reward function incorporating classification, regression, and formatting constraints is designed to refine prediction accuracy while preserving interpretability. Experimental results demonstrate that C2F-Thinker achieves competitive performance on fine-grained sentiment regression tasks while significantly outperforming baselines in cross-domain generalization. This highlights its potential in building trustworthy and robust sentiment analysis systems for real-world applications.

情感分析链式思维强化学习多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。