arXiv:2510.11496cs.CVcs.AI2025-10被引 6

AndesVL让手机端运行多模态大模型成为可能,性能媲美更大模型。

AndesVL Technical Report: An Efficient Mobile-side Multimodal Large Language Model

  • 基于Qwen3与视觉编码器,构建0.6B至4B参数的移动端多模态模型。
  • 在多个开源基准上表现领先,支持多图理解、数学推理、跨语言任务等。
  • 采用1+N LoRA与量化微调技术,实现在手机芯片上6.7倍加速、30.9%内存减少。

近年来,以QwenVL、InternVL、GPT-4o、Gemini和Claude Sonnet为代表的云端多模态大模型(MLLM)虽达数百亿参数量级并展现出卓越性能,但其内存、功耗与算力需求远超移动设备承载能力。本文提出AndesVL,一套基于Qwen3语言模型与多种视觉编码器构建的0.6B至4B参数移动端多模态大模型。我们系统阐述了AndesVL的模型架构、训练流程与训练数据,其在文本丰富的图像理解、推理与数学、多图解析、通用VQA、幻觉抑制、多语言理解及GUI相关任务等多项开源基准测试中达到一流水平,优于同规模先进模型。此外,我们引入1+N LoRA架构与量化感知的LoRA微调(QALFT)框架,实现移动端高效任务适配与模型压缩。结合自研缓存淘汰算法OKV、定制化推测解码与压缩策略,在联发科天玑9500芯片上部署AndesVL-4B时,实现峰值解码速度提升6.7倍,内存降低最高30.9%,权重压缩至1.8比特/权。所有模型已在HuggingFace公开发布。

原文摘要 · Abstract (English)

In recent years, while cloud-based MLLMs such as QwenVL, InternVL, GPT-4o, Gemini, and Claude Sonnet have demonstrated outstanding performance with enormous model sizes reaching hundreds of billions of parameters, they significantly surpass the limitations in memory, power consumption, and computing capacity of edge devices such as mobile phones. This paper introduces AndesVL, a suite of mobile-side MLLMs with 0.6B to 4B parameters based on Qwen3's LLM and various visual encoders. We comprehensively outline the model architectures, training pipeline, and training data of AndesVL, which achieves first-tier performance across a wide range of open-source benchmarks, including fields such as text-rich image understanding, reasoning and math, multi-image comprehension, general VQA, hallucination mitigation, multilingual understanding, and GUI-related tasks when compared with state-of-the-art models of a similar scale. Furthermore, we introduce a 1+N LoRA architecture alongside a Quantization-Aware LoRA Fine-Tuning (QALFT) framework to facilitate efficient task adaptation and model compression during mobile-side deployment of AndesVL. Moreover, utilizing our cache eviction algorithm -- OKV -- along with customized speculative decoding and compression strategies, we achieve a 6.7x peak decoding speedup ratio, up to 30.9% memory reduction, and 1.8 bits-per-weight when deploying AndesVL-4B on MediaTek Dimensity 9500 chips. We release all models on https://huggingface.co/OPPOer.

多模态移动端模型压缩LoRA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。