通过语法结构增强上下文定位,提升多模态情感分析的细粒度识别能力。
Dependency Structure Augmented Contextual Scoping Framework for Multimodal Aspect-Based Sentiment Analysis
- 利用依存句法树引导模型聚焦目标语境,精准捕捉情感线索。
- 在Twitter2015数据集上,F1提升2.3%,精确率提升3.5%。
- 适合需要细粒度情感理解的多模态应用开发者使用。
多模态方面级情感分析(MABSA)旨在从图文对中提取细粒度信息,识别方面词并判断其情感极性。现有方法难以同时应对三大挑战:情感线索感知(SCP)、多模态信息错位(MIM)和语义噪声消除(SNE)。为此,我们提出DASCO(依赖结构增强的作用域框架),一种面向细粒度作用域的框架,通过利用依存句法树增强方面级情感推理。首先,在基础模型上设计多任务预训练策略,融合方面导向增强、图文匹配与方面级情感敏感认知,提升模型对方面词和情感线索的感知能力,实现有效的图文对齐,缓解SCP与MIM问题。其次,将依存树作为语法分支,结合语义分支,引导模型在目标特定作用域内选择性关注关键上下文元素,有效过滤无关噪声,解决SNE问题。在两个基准数据集上的三个子任务上进行的大量实验表明,DASCO在MABSA上达到当前最优性能,尤其在Twitter2015数据集上,JMASA的F1提升2.3%,精确率提升3.5%。源代码已开源:https://github.com/LHaoooo/DASCO。
原文摘要 · Abstract (English)
Multimodal Aspect-Based Sentiment Analysis (MABSA) seeks to extract fine-grained information from image-text pairs to identify aspect terms and determine their sentiment polarity. However, existing approaches often fall short in simultaneously addressing three core challenges: Sentiment Cue Perception (SCP), Multimodal Information Misalignment (MIM), and Semantic Noise Elimination (SNE). To overcome these limitations, we propose DASCO (\textbf{D}ependency Structure \textbf{A}ugmented \textbf{Sco}ping Framework), a fine-grained scope-oriented framework that enhances aspect-level sentiment reasoning by leveraging dependency parsing trees. First, we designed a multi-task pretraining strategy for MABSA on our base model, combining aspect-oriented enhancement, image-text matching, and aspect-level sentiment-sensitive cognition. This improved the model's perception of aspect terms and sentiment cues while achieving effective image-text alignment, addressing key challenges like SCP and MIM. Furthermore, we incorporate dependency trees as syntactic branch combining with semantic branch, guiding the model to selectively attend to critical contextual elements within a target-specific scope while effectively filtering out irrelevant noise for addressing SNE problem. Extensive experiments on two benchmark datasets across three subtasks demonstrate that DASCO achieves state-of-the-art performance in MABSA, with notable gains in JMASA (+2.3\% F1 and +3.5\% precision on Twitter2015). The source code is available at https://github.com/LHaoooo/DASCO .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。