arXiv:2604.25452cs.CL2026-04

传统机器学习在印尼电商评论情感分析中表现接近甚至优于深度模型。

Benchmarking Logistic Regression, SVM, and LightGBM Against BiLSTM with Attention for Sentiment Analysis on Indonesian Product Reviews

论文配图:Benchmarking Logistic Regression, SVM, and LightGBM Against BiLSTM with Attention for Sentiment Analysis on Indonesian Product Reviews
图 1 · 摘自论文原文
  • 用PyCaret自动比较LR、SVM、LightGBM与带注意力的BiLSTM
  • ML模型最高准确率97.26%,深度模型为97.24%,差距极小
  • 适合追求效率且数据量适中的自然语言处理项目

电商平台产品评论的情感分析对理解用户满意度并为卖家提供改进建议至关重要。本文通过全面基准测试,对比了基于PyCaret AutoML框架的机器学习(ML)方法与基于双向长短期记忆网络(BiLSTM)结合注意力机制的深度学习(DL)方法,在印尼语产品评论上的二分类情感分析性能。数据集包含19,728条样本,正负评论数量均衡。在ML方法中,采用10折分层交叉验证评估了逻辑回归(LR)、线性核支持向量机(SVM)和轻量梯度提升机(LightGBM)。其中逻辑回归表现最佳,准确率为97.26%,F1分数为97.26%。而BiLSTM+注意力模型在3,946个独立测试样本上达到97.24%准确率和97.24% F1分数。结果表明,经过适当预处理与特征提取的传统机器学习算法在高维数据上可与复杂序列深度学习架构相媲美,且具备更高计算效率。

原文摘要 · Abstract (English)

Sentiment analysis of product reviews on e-commerce platforms plays a critical role in automatically understanding customer satisfaction and providing actionable insights for sellers seeking to improve product quality. This paper presents a comprehensive benchmarking study comparing a Machine Learning (ML) approach via the PyCaret AutoML framework against a Deep Learning (DL) approach based on a Bidirectional Long Short-Term Memory (BiLSTM) architecture with an Attention mechanism for binary sentiment classification on Indonesian product reviews. The dataset comprises 19,728 samples balanced equally between positive and negative reviews. For the ML approach, three prominent algorithms were evaluated via 10-fold stratified cross-validation: Logistic Regression (LR), Support Vector Machine (SVM) with a linear kernel, and Light Gradient Boosting Machine (LightGBM). Logistic Regression achieved the best ML performance with an accuracy of 97.26\% and an F1-score of 97.26\%. The BiLSTM with Attention model, evaluated on 3,946 held-out test samples, achieved an accuracy of 97.24\% and an F1-score of 97.24\%. These comparative results demonstrate that traditional ML algorithms with proper preprocessing and feature extraction can compete closely with, and even marginally outperform, more complex sequential DL architectures on high-dimensional datasets, while simultaneously offering greater computational efficiency.

情感分析机器学习深度学习印尼语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。