用结构化上下文提升大模型情感分析一致性,让企业决策更可靠。
Consistency Analysis of Sentiment Predictions using Syntactic & Semantic Context Assessment Summarization (SSAS)

- 构建分层上下文框架,通过摘要迭代强化文本语义聚焦
- 在三大数据集上使数据质量提升30%,减少预测波动
- 适合需要稳定情感分析的企业级应用与数据清洗场景
将大语言模型(LLM)用于可靠的企业级分析(如情感预测)的核心挑战,在于其固有的随机性与分析所需的稳定性之间的矛盾。混乱现代数据集的噪声与LLM的非确定性共同导致情感预测过于波动,难以支撑战略决策。为此,我们提出一种句法与语义上下文评估摘要框架(SSAS),通过层级分类结构(主题、故事、聚类)与基于摘要的迭代计算架构(SoS),建立约束注意力机制的上下文。该方法为原始文本生成高信噪比、情感密集的提示,有效抑制无关信息与分析方差。我们在Gemini 2.0 Flash Lite上,对比直接使用LLM的方法,在Amazon产品评论、Google商业评论、Goodreads书籍评论三个标准数据集及多种鲁棒性场景下进行评估。结果表明,SSAS可显著提升数据质量达30%,通过降噪与情感预测精度改善,实现上下文估计的一致性,为决策提供稳定可靠的证据基础。
原文摘要 · Abstract (English)
The fundamental challenge of using Large Language Models (LLMs) for reliable, enterprise-grade analytics, such as sentiment prediction, is the conflict between the LLMs' inherent stochasticity (generative, non-deterministic nature) and the analytical requirement for consistency. The LLM inconsistency, coupled with the noisy nature of chaotic modern datasets, renders sentiment predictions too volatile for strategic business decisions. To resolve this, we present a Syntactic & Semantic Context Assessment Summarization (SSAS) framework for establishing context. Context established by SSAS functions as a sophisticated data pre-processing framework that enforces a bounded attention mechanism on LLMs. It achieves this by applying a hierarchical classification structure (Themes, Stories, Clusters) and an iterative Summary-of-Summaries (SoS) based context computation architecture. This endows the raw text with high-signal, sentiment-dense prompts, that effectively mitigate both irrelevant data and analytical variance. We empirically evaluated the efficacy of SSAS, using Gemini 2.0 Flash Lite, against a direct-LLM approach across three industry-standard datasets - Amazon Product Reviews, Google Business Reviews, Goodreads Book Reviews - and multiple robustness scenarios. Our results show that our SSAS framework is capable of significantly improving data quality, up to 30%, through a combination of noise removal and improvement in the estimation of sentiment prediction. Ultimately, consistency in our context-estimation capabilities provides a stable and reliable evidence base for decision-making.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。