arXiv:2608.20831cs.CLcs.AI2026-08

针对情感分析中细粒度四元组提取的模型压缩难题,提出结构感知的在线奖励蒸馏方法。

STAR-OPD: Structured Aspect-Cascade-Aware On-Policy Reward Distillation for ABSA Quadruple Extraction

论文配图:STAR-OPD: Structured Aspect-Cascade-Aware On-Policy Reward Distillation for ABSA Quadruple Extraction
图 1 · 摘自论文原文
  • 基于学生模型自生成轨迹进行在线蒸馏,关注目标-方面绑定一致性
  • 在E-ABSA20K和SemEval-2014上显著降低目标幻觉,提升结构复杂案例表现
  • 适合需要高效部署且保持高精度的细粒度情感分析应用

基于方面的情感分析(ABSA)四元组抽取需联合预测评论中的目标、方面、观点与情感,常包含多个细粒度情感三元组。尽管大链式思维(CoT)模型表现优异,但将其压缩为轻量级可部署模型仍具挑战。我们发现蒸馏过程中学生模型在目标-方面接口处的错误会引发结构非法状态,如绑定断裂和目标幻觉,进而污染下游预测。传统离线蒸馏因仅依赖教师生成轨迹,无法有效监督学生引入的结构状态,导致性能下降。为此,提出STAR-OPD(结构化方面级联感知在线奖励蒸馏),基于通用在线蒸馏框架,专用于ABSA四元组抽取,采用级联感知、集合结构化的奖励机制。STAR-OPD在学生自生成轨迹上训练,通过直接优化绑定一致性、目标定位与细粒度方面消歧的奖励函数实现改进。在E-ABSA20K和SemEval-2014上的实验表明,该方法持续优于离线及通用在线基线,减少目标幻觉,并显著提升结构困难案例的表现。使用Qwen3-4B时,显著缩小师生差距的同时提升推理效率,凸显了对蒸馏后模型进行在线结构修正的重要性。

原文摘要 · Abstract (English)

Aspect-based sentiment analysis (ABSA) quadruple extraction requires jointly predicting target, aspect, opinion, and sentiment over reviews that often contain multiple fine-grained sentiment tuples. While large chain-of-thought (CoT) models perform well on this task, distilling them into smaller deployable models remains difficult. We identify a task-specific failure mode in distilled ABSA extraction: student errors at the target-aspect interface create structurally invalid states, such as broken target-aspect bindings and hallucinated targets, which then corrupt downstream predictions. Conventional off-policy distillation is poorly suited to this setting because it trains only on teacher-generated trajectories and provides little supervision on the student-induced structural states that dominate inference. To address this mismatch, we propose STAR-OPD (STructured Aspect-cascade-aware On-Policy Reward Distillation), which builds on generic on-policy distillation and instantiates it for ABSA quadruple extraction with cascade-aware, set-structured rewards. STAR-OPD trains on student rollouts and applies set-structured rewards that directly target binding consistency, target grounding, and fine-grained aspect disambiguation. Experiments on E-ABSA20K and SemEval-2014 show that STAR-OPD consistently outperforms off-policy and general on-policy baselines, reduces target hallucination, and substantially improves performance on structurally hard cases. With Qwen3-4B, STAR-OPD substantially narrows the student-teacher gap while improving inference efficiency, highlighting the importance of on-policy structural correction for distilled ABSA extraction.

情感分析知识蒸馏四元组抽取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。