arXiv:2510.13405cs.LGcs.NI2025-10被引 2

通过智能去重与分片,让手机应用行为日志减少44%存储占用。

Optimizing Storage Overhead of User Behavior Log for ML-embedded Mobile Apps

  • 构建超图匹配模型,消除跨特征重复行为记录
  • 采用虚拟哈希分片,使日志存储更密集,节省30%以上空间
  • 支持动态更新,仅增加2秒延迟,适合实时移动设备部署

机器学习模型在现代移动应用中日益普及,依赖历史用户行为数据以捕捉用户意图。然而,随着服务增多,行为日志的存储成本显著上升,导致系统响应变慢、应用卸载率增加。为解决这一存储瓶颈,我们提出AdaLog——一种轻量级自适应系统,可在不损失模型推理精度或延迟的前提下,提升移动应用行为日志的存储效率。分析发现当前工业实践存在两大低效问题:(i) 不同特征与模型间重复记录重叠行为数据;(ii) 异构属性描述导致单个日志文件存储稀疏。AdaLog将特征级冗余消除建模为超图上的最大加权匹配问题,提出可本地部署的分层算法;同时采用虚拟哈希属性设计,将异构行为分布到少数日志文件中实现物理密集存储。为支持动态行为模式,设计增量更新机制,最大限度减少I/O操作。我们与行业伙伴合作,在主流移动应用中部署了原型系统。基于真实用户数据的评估显示,AdaLog使行为日志大小减少19%至44%,系统开销极小(仅增加2秒延迟和15 MB内存使用),为设备端机器学习的广泛落地提供了更高效的存储基础。

原文摘要 · Abstract (English)

Machine learning (ML) models are increasingly integrated into modern mobile apps to enable personalized and intelligent services. These models typically rely on rich input features derived from historical user behaviors to capture user intents. However, as ML-driven services become more prevalent, recording necessary user behavior data imposes substantial storage cost on mobile apps, leading to lower system responsiveness and more app uninstalls. To address this storage bottleneck, we present AdaLog, a lightweight and adaptive system designed to improve the storage efficiency of user behavior log in ML-embedded mobile apps, without compromising model inference accuracy or latency. We identify two key inefficiencies in current industrial practices of user behavior log: (i) redundant logging of overlapping behavior data across different features and models, and (ii) sparse storage caused by storing behaviors with heterogeneous attribute descriptions in a single log file. To solve these issues, AdaLog first formulates the elimination of feature-level redundant data as a maximum weighted matching problem in hypergraphs, and proposes a hierarchical algorithm for efficient on-device deployment. Then, AdaLog employs a virtually hashed attribute design to distribute heterogeneous behaviors into a few log files with physically dense storage. Finally, to ensure scalability to dynamic user behavior patterns, AdaLog designs an incremental update mechanism to minimize the I/O operations needed for adapting outdated behavior log. We implement a prototype of AdaLog and deploy it into popular mobile apps in collaboration with our industry partner. Evaluations on real-world user data show that AdaLog reduces behavior log size by 19% to 44% with minimal system overhead (only 2 seconds latency and 15 MB memory usage), providing a more efficient data foundation for broader adoption of on-device ML.

移动计算日志优化ML嵌入存储压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。