arXiv:2604.13560cs.LGcs.ET2026-04

用量子头替代传统模型头,让多任务学习更省参数。

Parameter-efficient Quantum Multi-task Learning

论文配图:Parameter-efficient Quantum Multi-task Learning
图 1 · 摘自论文原文
  • 用量子线路做共享编码+轻量适配块,实现高效多任务
  • 任务越多越省参数,线性增长比经典方法的平方增长优
  • 适合想在量子设备上做多任务学习的研究者

多任务学习通过共享表示联合学习相关任务,提升泛化能力和数据效率。在广泛使用的硬共享设置中,共享主干搭配任务特定预测头,但任务头参数随任务数快速增长。为在保持任务专精的同时提高参数效率,本文提出一种参数高效的量子多任务学习(QMTL)框架。该框架将传统任务特定线性头替换为全量子预测头,采用混合架构:先通过共享、任务无关的量子编码阶段映射数据,再由轻量级任务特定变分线路实现局部适应,同时保持紧凑参数化。在受控且容量匹配的设定下,共享表示维度随任务数增长,分析表明标准经典头参数呈二次增长,而所提量子头仅线性增长。在自然语言处理、医学影像和多模态讽刺检测三个多任务基准上评估,性能可媲美甚至超越经典基线,且显著优于现有混合量子多任务模型,同时使用更少的头参数。进一步在噪声模拟器和真实量子硬件上验证了其可行性。

原文摘要 · Abstract (English)

Multi-task learning (MTL) improves generalization and data efficiency by jointly learning related tasks through shared representations. In the widely used hard-parameter-sharing setting, a shared backbone is combined with task-specific prediction heads. However, task-specific parameters can grow rapidly with the number of tasks. Therefore, designing multi-task heads that preserve task specialization while improving parameter efficiency remains a key challenge. In Quantum Machine Learning (QML), variational quantum circuits (VQCs) provide a compact mechanism for mapping classical data to quantum states residing in high-dimensional Hilbert spaces, enabling expressive representations within constrained parameter budgets. We propose a parameter-efficient quantum multi-task learning (QMTL) framework that replaces conventional task-specific linear heads with a fully quantum prediction head in a hybrid architecture. The model consists of a VQC with a shared, task-independent quantum encoding stage, followed by lightweight task-specific ansatz blocks enabling localized task adaptation while maintaining compact parameterization. Under a controlled and capacity-matched formulation where the shared representation dimension grows with the number of tasks, our parameter-scaling analysis demonstrates that a standard classical head exhibits quadratic growth, whereas the proposed quantum head parameter cost scales linearly. We evaluate QMTL on three multi-task benchmarks spanning natural language processing, medical imaging, and multimodal sarcasm detection, where we achieve performance comparable to, and in some cases exceeding, classical hard-parameter-sharing baselines while consistently outperforming existing hybrid quantum MTL models with substantially fewer head parameters. We further demonstrate QMTL's executability on noisy simulators and real quantum hardware, illustrating its feasibility.

量子机器学习多任务学习参数效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。