用轻量级多模态模型融合界面与文本,精准预测应用评分
A Lightweight Vision-Language Fusion Framework for Predicting App Ratings from User Interfaces and Metadata
- 结合MobileNetV3和DistilBERT提取界面与文本特征,通过门控融合模块整合
- 在20轮训练后达到MAE 0.1060、R2 0.8529,相关性高达0.9251
- 模型轻量适合边缘部署,对开发者优化应用有实用价值
应用评分是衡量移动应用质量、可用性和用户满意度的重要指标。现有评分预测模型多仅依赖文本或用户界面(UI)特征,忽视了视觉与语义信息的联合利用。为此,本文提出一种轻量级视觉-语言融合框架,同时融合移动端界面布局与语义信息进行评分预测。该框架采用MobileNetV3提取界面视觉特征,使用DistilBERT提取文本特征,通过带有Swish激活函数的门控融合模块进行多模态特征融合,再经多层感知机回归头输出预测结果。模型在20个训练周期后,取得平均绝对误差(MAE)0.1060、均方根误差(RMSE)0.1433、均方误差(MSE)0.0205、决定系数(R²)0.8529以及皮尔逊相关系数0.9251的性能表现。大量消融实验验证了不同视觉与文本编码器组合的有效性。整体而言,该轻量级框架为开发者和用户提供有价值参考,支持可持续应用开发,并可在边缘设备高效部署。
原文摘要 · Abstract (English)
App ratings are among the most significant indicators of the quality, usability, and overall user satisfaction of mobile applications. However, existing app rating prediction models are largely limited to textual data or user interface (UI) features, overlooking the importance of jointly leveraging UI and semantic information. To address these limitations, this study proposes a lightweight vision--language framework that integrates both mobile UI and semantic information for app rating prediction. The framework combines MobileNetV3 to extract visual features from UI layouts and DistilBERT to extract textual features. These multimodal features are fused through a gated fusion module with Swish activations, followed by a multilayer perceptron (MLP) regression head. The proposed model is evaluated using mean absolute error (MAE), root mean square error (RMSE), mean squared error (MSE), coefficient of determination (R2), and Pearson correlation. After training for 20 epochs, the model achieves an MAE of 0.1060, an RMSE of 0.1433, an MSE of 0.0205, an R2 of 0.8529, and a Pearson correlation of 0.9251. Extensive ablation studies further demonstrate the effectiveness of different combinations of visual and textual encoders. Overall, the proposed lightweight framework provides valuable insights for developers and end users, supports sustainable app development, and enables efficient deployment on edge devices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。