arXiv:2603.21508cs.LGcs.AI2026-03

优化手机端特征提取,让模型推理更快更省电。

Optimizing Feature Extraction for On-device Model Inference with User Behavior Sequences

  • 将特征提取流程建模为有向无环图,自动识别冗余操作。
  • 在真实应用中降低1.33倍至4.53倍的端上推理延迟。
  • 适合移动端模型部署、追求低延迟体验的开发者。

机器学习模型广泛应用于现代移动应用中,用于分析用户行为并提供个性化服务。保证低延迟的端上模型执行对维持高质量用户体验至关重要。以往研究主要关注给定输入特征下的模型推理加速,但我们发现实际端上推理流程中的一个被忽视的瓶颈:从原始应用日志中提取输入特征。本文探索通过分析并消除不同模型特征间及连续推理间的冗余提取操作来优化特征提取。我们提出AutoFeature,一种自动化的特征提取引擎,在不降低模型推理准确率的前提下加速端上特征提取。其核心设计包括:(1) 图抽象,将不同输入特征的提取流程表示为有向无环图;(2) 图优化,识别并融合图中跨特征的冗余操作节点;(3) 高效缓存,减少连续推理间重叠原始数据的操作。我们在五个工业级移动服务(涵盖搜索、视频和电商领域)中实现了AutoFeature原型系统。在线评估显示,白天端到端推理延迟降低1.33倍至3.93倍,夜间降低1.43倍至4.53倍。

原文摘要 · Abstract (English)

Machine learning models are widely integrated into modern mobile apps to analyze user behaviors and deliver personalized services. Ensuring low-latency on-device model execution is critical for maintaining high-quality user experiences. While prior research has primarily focused on accelerating model inference with given input features, we identify an overlooked bottleneck in real-world on-device model execution pipelines: extracting input features from raw application logs. In this work, we explore a new direction of feature extraction optimization by analyzing and eliminating redundant extraction operations across different model features and consecutive model inferences. We then introduce AutoFeature, an automated feature extraction engine designed to accelerate on-device feature extraction process without compromising model inference accuracy. AutoFeature comprises three core designs: (1) graph abstraction to formulate the extraction workflows of different input features as one directed acyclic graph, (2) graph optimization to identify and fuse redundant operation nodes across different features within the graph; (3) efficient caching to minimize operations on overlapping raw data between consecutive model inferences. We implement a system prototype of AutoFeature and integrate it into five industrial mobile services spanning search, video and e-commerce domains. Online evaluations show that AutoFeature reduces end-to-end on-device model execution latency by 1.33x-3.93x during daytime and 1.43x-4.53x at night.

端上推理特征提取性能优化移动设备

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。