大模型正让手机更智能，本地运行提升隐私与响应速度。
A Contemporary Overview: Trends and Applications of Large Language Models on Mobile Devices
- 将大模型部署到手机端，实现本地高效推理。
- 结合5G与神经网络加速器，实现低延迟响应。
- 适合关注移动端AI、隐私保护的开发者和研究者。
随着大型语言模型（LLMs）在自然语言处理与生成方面展现出强大能力，其在移动设备上的部署正成为智能设备领域的重要趋势。LLMs已在语音助手、实时翻译和智能推荐等应用中展现巨大潜力。得益于神经网络加速器等硬件技术进步及5G等网络基础设施发展，移动设备实现了高效的本地推理与低延迟智能响应，减少了对云端计算的依赖，同时提升了数据隐私与安全性。开发者可通过开放API和SDK便捷集成LLM功能，推动更创新的智能应用诞生。大模型的普及不仅增强了移动设备的智能化水平，还促进了增强现实（AR）与物联网（IoT）等领域的融合创新。这一趋势有望驱动下一代移动智能应用的发展。
原文摘要 · Abstract (English)
With the rapid development of large language models (LLMs), which possess powerful natural language processing and generation capabilities, LLMs are poised to provide more natural and personalized user experiences. Their deployment on mobile devices is gradually becoming a significant trend in the field of intelligent devices. LLMs have demonstrated tremendous potential in applications such as voice assistants, real-time translation, and intelligent recommendations. Advancements in hardware technologies (such as neural network accelerators) and network infrastructure (such as 5G) have enabled efficient local inference and low-latency intelligent responses on mobile devices. This reduces reliance on cloud computing while enhancing data privacy and security. Developers can easily integrate LLM functionalities through open APIs and SDKs, enabling the creation of more innovative intelligent applications. The widespread use of LLMs not only enhances the intelligence of mobile devices but also fosters the integrated innovation of fields like augmented reality (AR) and the Internet of Things (IoT). This trend is expected to drive the development of the next generation of mobile intelligent applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。